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Grade 12 students improved in written expression ajid spelling, held 
steady in mathematics, but continued to decline ii^i^ readings (4) 
Equating studies indicated that grades 3 and 6 seeded above the 
national median; grade 12 scored below. (5) At all irade levels^ 
females outscored males in reading, while the reverSif was true of 
math. (6) Pupils who spoke limited English scor€d sirtstantially lower 
than fluent English groups. (7) Test scores and soci econoiic status 
were directly related. (8) Student mobility continued ;to inci-ease* 
Recognized authorities made instructional rccommcndati^jons in each 
content area based upon the findings. Sample'' test gues*;]cns are 
presented to illustrate the relative strengths and weak^^sses of 
California students, (Author/CP) 
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I. Summary of Findings 



During the 1977-73 school year, all second grade pupils (311,905) and third 
grade pupils (301,022) in California public schools were tested in reading 
achievement. All pupils in grade six (294,794) and grade twelve (244,233) 
were tested in the basic skills of reading, written expression, spelling, and 
mathematics. 

Grades Two and Three Results 

Reading achievement test scores for second and third grade pupils have been 
improving steadily since statewide testing in those grades began in 1966. 
This trend has continued through 1978. A sunmary of the test results is 
presented in Table 1. The overall gain in 1977-78 of second grade pupils was 
0.5 percent correct, and the overall eain of pupils in grade three was 0.5 
De'Tcent correct. These gains reflect pupil pt:rf oriLance on the California 
Assessment Program's Reading^ '^5.^^ * which was constructed specifically to assess 
the students' attainment of proficiency in the broad range of reading programs 
in California's public schools. 

special equating studies were conducted to determine the relationship of 
the current performance of California pupils to the 1973 (the latest year for 
which comparable figures were available) performance of a sample of pupils 
across the nation. The median second and third grade pupils in California 
were determined to be at the 55th and 57th percentile ranks, respectively. 



Grade Six Results 

All students in grade six took the Survev of Basic Skills: Grade 6 , another 
test developed (in 1074-75) specifically for the California Assessment Program. 
The scores of California sixth grade students improved in all content areas 
tested: reading, written expression, spelling, and mathematics (see Table 1). 
The gain was greatest in mathematics (0.8 percent correct) and l^ast in reading 
(0.4 percent correct). An equal amount of gain (0.5 percent correct) was 
achieved in the areas of written expression and ppelling. 

An equating study provided a basis for comparing California students with a 
national sample of students tested in 1973. Based on the results of the study, 
the median sixth grade student in California is now above the national median 
in all areas. In mathematics the median sixth grader in California moved from 
the 51st CO the 53rd percentile ra^k in 1977-78. The median student moved 
from the 53rd to the 55th percentile rank in reading and remained at the 51st 
percentile rank in written expression. 



2 Student Achievement in California Schools 

The report includes an analysis of the differences between tiie relative 
performances ^f boys and girls for each of the skill areas vdthin mathematics. 
Overall, boys continue to score higher f.han girls, with the notable exceptions 
in the areas of whole number computations, fraction computations^ and decimal 
computations. For more complex tasks, especially those involving reasoning 
and problem solving, however, the reverse trend is equally strong; that is, 
the boys outscore the girls. 

Grade Twelve Results 

All students in grade twelve took the same test that was administered in 
1976-77 — the Survey of Basic Skills: Grade 12 . Reading performance continued 
to decline (by 0.3 percent correct), mathematics scores held steady; and 
written expression and spelJing both improved (0.2 and 0.5 percent correct, 
respectively) . 

Special equating studies provide a basis for comparing the performance of 
California twelfth graders with that of national test publishers* norm samples 
tested in 1962 and 1970. On the basis of the 1962 norms, the median twelfth 
grade student in Calif orn:-' it in 1977-78 was at the 42nd percentile rank in 
reading, the 34th perceniii^e rank in written expression, and the 43rd percentile 
rank in mathematics. 

Comparisons with two other tests with 1970 norms placed California twelfth grade 
students somewhat lower: at the 32ad and 35th percentiles in reading, at the 
26th and 28th percentiles in written expression; and at the 41st and 43rd 
percentiles in mathematics. 

The relative performance of boys and girls was also analyzed for grade 
twelve mathematics. The gap between boys and girls is substantial by this 
grade level, with boys typically scoring higher. The only skill areas in 
which girls consistently outscore boys are those of whole number and decimal 
computations, as was also true for grade six. The girls at the twelfth grade 
scored especially low in measurement, geometric applications, and probability 
and statistics. The report also includes an analysis of the results for boys 
and girls according to the number of mathematics couriaes they had completed. 

Subgroup analyses 

Statewide test performance was analyzed separately for several different 
subgri^ups of pupils. A summary of the main fin<?ings is presented below: 

1. Girls scored higher than boys did in reading, and boys scored higher 
than girls did in mathematics. In reading, the gap between the boys 
and girls continued to decrease at all grade levels. The difference 
between boys and girls in mathematics did not change s±uce 1976-77. 
Most of these differences are quite small; however, the boys* lead in 
mathematics at grade twelve is quite substantial. 
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Table 1 



Number of Stuaerits Tested and Average Percent of Questions Answered Correctly 
by Grade Level and Content Area for 1975-76, 1976-77, and 1977-78 
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Student Achievement In C^jtlifoznla Schools 



2. Pupils who spoke Jap'anese or Chinese in addition to fluent English scored 
higher than any other group of pupils (grouped according to language 
background). Pupils who spoke only English scored nearly as high. The 
students who spoke limited English and another language scored substantia 
lower than the other groups. Nearly all groups scored higher in 1977-7S 
than in 1976-77. 

Within the two categories of ''fluent English and another laagc^a^e'' aud 
'limited English and another language," those students whose other 
language was Spcir.ish scored substantially lower than those whose 
other language was other than Spanish. Further, a greater propcrticn 
of students were coded in these categories in 1977-78. 

3. There was a fairly direct** relationsliip between test scores anu parental 
occupational level* The higher a parent's occupational level, as defined 
ciiiefly by the amount of education required for the parent's occupation, 
the higher the student's test scores. More significantly, the gap 
between the average scores of the pupils from the highest economic, or 
occupational, levels and those from the lowest economic levels continued 
decrease since 1976-77. 

4. Pupil mobility continued to increase from 1976-77 to 1977-78. Although 
the less mobile pupils continue to score higher than the more mobile 
pupils, the margin continued to shrink. 

The major portion of this report is devoted to a-i analysis of the specific 
test findings for each subject area. Example test questions are presented to 
illustrate ti - relative strengths and weaknesses of California students. The 
discussion of results for each content area is based heavily on the connnents 
of recognized authorities who reviewed the f indi: gs and pointed out implica- 
tions for the improvement of California's school programs. 



introduction to the Report 



Tliis repoft contains the complete statewide results of the Califoruia 
Assessment Pro^'-Tm, including the following key features; 

• ^^t:al i^^ .i.ndings . Information is presented not cnly for the 
major content areas of reading, v^ritten expression., and mathe- 
matics but also for a variety of specific skill areas within 
each major area. This year for the first time, the skill area 
findings for mathematics have been analyzed and reported 
separately for boy;? and girls, 

« National comparison s . Although tests were developed to cor- 
respond specifically to the skills and concepts being taught 
in California schools, special studies have been conducted 
to show hew the performance of California students contpares 
with th£:c of recently tested samples of students from through- 
out the nation. 

Expert opinions . Recognized authorities in each professional 
field have presented their interpretations of the results for 
each of the content areas by identifying skill areas of 
relatively impressive student performance and other skill 
areas that need attention. This year's report also offers 
some classroom instructional strategies suggested by the 
various subject matter committees to overcome theie weak- 
nesses in student performance. 

• Comparable results > The tests used in the California Assessment 
Program have been developed and refined to the extent that 

they can continue to be used without revision for a period of 
years. All results in this report are comparable to those of 
the last two years. 

• Subgroup analyses . With the stability of the tests, it has 
become possible and ,app^ropriate to examine the differences 
in standing and in rate of progress among various subgroups 
of pupils. Three years of findings for different groups of 
pupils are included in this yearns report. 



Development of the California Assessment Program 



The California Assessment Program was first fully implemented in 1974-75. 
In design, development, and procedures, it is unique in the nation. The 



assessment program was 'icsigned vith several criteria in nind: Cm [i: ::ust 
be relevant to California sohoois; (2) It vnist. cover fhe fv:].l rang(!^ of 
instructional objective.'.;; (3) It must provide prograjr^-di^gnos tic inzor-^tiou 
at the local and state levels; and it must rake cnly a minimiir-t of ::::cin 

time. Tlr-is ^.iection describes tlu* process of deveU-.oing such a prograi:.. 



Back^X9Affl<^ and Assiimp^tions 

Tlie new assessment program had itr. foundation i.n cwo legislative acts: (l } th 
California School Tp.sting Act of 1969, a revi sion of a 1961 lav which iir.sL 
required an achievement testing program .n th.^. public schools; cvnd (2) ihe 
Mi.Iler-rjnruh Basic Reading Act, T^iich originally required reading tests in 
grades one, two, and three. The testing program was revised by 1972 legi:;la- 
tion, and major changes were made in the prograjn as a result of that legisla- 
tion. 



llie changes in the statewide testing prograjo were based on the principle thar 
an efficient state testing program has to be limited in scope--that is, 
limited primarily to the task of furnishing useful information to state- 
level policy-makers and dec is ion -makers . It was assumed that the program 
could not meet all of the many information needs of local school district 
personnel and th^it assessment information needed at the classroom level could 
best be collected by local school personnel. 

In spite of this assumption, the program was designed to report as much in- 
formation ao possible to local personnel. Since all students at a grade 
level in all schools were tested, it was possible to provide very detailed 
analytical reports for each school to supplement locally obtained information 
In fact, the results of a survey of all districts iu California showed that 
most districts have found this unique information' very useful in evaluating 
and revising programs. Board members and ether local citijsen" have relied 
heavily upon .^^tatewide results in making judgments about local needs and 
accomplishments primarily because of the uniform and comoavable nature of 
the iniormation provided. 



Reasons for Revisinj^ the Testi ng Program 

Two major problems were addressed through the revision of the statewide 
testing program: 

1- Test rel evancy and breadt hs Ttie incomplete match between the rela- 
tively narrow range of skills measured by any one published stan- 
dardized test, on the one hand, and the variety of Instructional 
programs in California schools, on the other » made it difficult to 
assess the skills of California students or the effectiveness of 
the programs with any degree of arcjurance of fairness. Furthermore, 
it was not possible tc assess the relative strengths and weaknesses 
of California students in order to hav^ an indication of how in- 
structional programs should be redirecte>v since the standardized 
tests being used yielded only total scores. 
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2. 



Testing tline. Previous tesff equired an inordinate 

amount of pupil time fcr tb -inordinate, at least, 

in relation to the usefulr . The use of a new • 

testing technique called n ml .as now reduced the amount 

of testing time at certain gi.<a... .eveio from as much as three and 
one-half hours to 30 minutes. Ifader this sanq)iing method, all 
students at a grade level in all schools are tested, but each student 
takes only a portion of the total test. Results for an individual 
student cannot be obtained, but quite accurate estimates of the 
overall performance of groups of students can be computed. 



Development of the New Tests 

The development of tests related to California goals and objectives followed 
a rigorous procedure. The major steps are outlined below; 

1. Statewide committees of content area experts were formed and charged 
with the task of translating and delineating the general goals found 
in state-adopted curriculum frameworks into more specific objectives 
appropriate for assessment. 

2. These specific objectives, or test content specifications, were then 
reviewed by personnel in all California school districts for com- 
pleteness and relevance to their instructional programs. The revised 
specifications served as the basic guidelines for selecting and 
developing pools of test items. These documents were subsequently 
printed and distributed to all school districts under the general 
title Test Content Specifications . 

3. These content specifications were sent to major test publishers who 
identified those test questions lAich matched the specifications. 
These were submitted to the Department of Education for review. 

4. From the initially large pools of items, teams of classroom teachers 
reviewed and selected the items that were most appropriate for 
California students. 

5. These items were then reviewed by linguists and minority group testinf 
experts for any subtle biases against students of different language 
or cultural backgroimds . 

6" The final pools of items, several hundred at each grade level were 
.then divided into several short tests or forms- -from 10 to 18 per 
grade level. All test forms were made equivalent in difficulty and 
in coverage of major skill areas. 



The National Norm Diler«ni> i; 

Since 1962, the first year i^f statewide testing in California, all tests 
adopted for use had been conmercially published instruments with '"national" 
norms. The new tests described in this report were constructed specifically 
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for VjG in California schools. Uie decision to develop tests' rather than uce 
commercial "off-the-shelf" nests with national norms was not made casually. 
Comparison to national airerages are not or* ly i^^< -ppt-fn^^ ^-'t^ are useful as a 
basis for juc'jjing the overall relative rtfectl^^rx » _ nia's instruc- 

tional programs. Furtnermore, Califoiui \ci sections 60663 

and 60640) requires that such information Dt: autu. avai.i ^ 

A real dilemma, one with both philosophical and technical aspects, faces any- 
one who would measure the basic skills of California students: to choose a 
test which has national norms but fails to address all the skills taught in 
California schools, or to develop a relevant test which does not allow easy 
and immediate national comparisons. Assessment programs in other states are 
about equally divided between these two approaches. After eleven years of using 
tests with national norms but less than satisfactory coverage of the skills 
bein* taught in California schools and after observing the difficulties faced 
by other states in interpreting the results from their own tests without national 
norms the course to be followed was obvious: Develop a test which fits the 
instructional programs of most California schools and then find a way to com- 
pare those results to national norms. 

A plan which could accomplish this (allow one to have one's cake and tat it 
too) had to overcome two main problems with the national norms associated 
with published standardized tests. 

1. No single test is given to all students in the country. Of necessity, 
a publisher's norm is, therefore, only an estimate of what the dis- 
tribution of scores would be like if, in fact; the test had been 
taken by all students in the United States. For this reason, norms 
vary from publisher to publisher, sometimes in the extreme. In 
California's own recent history, the Stanford Reading Test was 
administered to all second grade pupils in the 1969-^0 school year, 
and the median California pupil scored at the 38th percentile of 

that publisher's norms. In the following year the Cooperative 
Primary Reading Test was administered to all second grade pupils.^ 
The median California pupil scored at the 50th percentile of that 
publisher's norms. The different result was clearly a reflection 
more of the difference in norms than of the difference in reading 
achievement. V 

2. A second problem with norms is that they are not updated very often. 
For . instance, the Cooperative Primary Reading Test was normed during 
the 1965-66 school year. As a result, when those norms are referred 
to, it must be clearly understood that the comparisons being made are 
to the publisher's estimate of what scores on that test would have 
been if administered to all pupils in the country at that time. If 
reading scores for the nation had dropped continuously since 1965-66, 
an "average" score for California pupils might, in fact, rdflect 
achievement far above current nationwide averages. 

The resulting plan is straightforward and efficient. It involves the equating 
of the California tests to standardized tests with national norms and updating 
those comparisons as new norms or new tests, become available. The equating' 
process requires that a sample of pupils take both the California test and one 
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of the other tests. The effect of the statistical analyses following the 
testing is to show how California students would have scored if they had all 
Laken the standardized test. Following recent refinements to the equating 
procedures, a study now has to be conducted only once, but the annual pro- 
gress on the California test can be translated into the appropriate national 
percentile ranks (against the vp-'t- in which the publisher's test was normed, 
of course, not against the vr erforxoance for that yaar. The latter 

would be most useful info**- it is simply not obtainable). 

This solution has several : (1) the national comparisons are more 

timely since they can be upuciLcw. new norms become available; (2) the 
estimates are more stable since they do not depend on the representativeness 
of a single publisher's sample; and (3) it allows California schools to be 
assessed with a test which fits the objectives of the instructional program, 
and simultaneously, with almost no additional testing, allows that performance 
to be compared to national noms. 

Essential Information About the Numbers Used in This Report 

The percent correct score . The statistic used in this report to indicate 
the achievement levels of California pupils is the "average percent correct 
score." For a given set of test questions, this nximber is the percentage of 
correct test responses, «/ith one response being equal to the answer of one 
student to one question, and the total nxunber of responses being equal to 
the answer of one student to one question, and the tot^l nximber of responses 
being equal to the number of students multiplied by the number of items on the 
test. For example, if three students took a test with' ten questions and if 
each of the three answered five of the ten questions correctly, the total 
number of responses would be 30, the total nimiber correct would be 15, and the 
average percent correct score would be 50. It can .also be said that the 
average student answered 50 percent of the questions correctly; or that, on 
the average, 50 percent of the questions were answered correctly. 

The average percent correct score and the simultaneous presentation of il- 
lustrative test questions or exercises are designed to add to the clarity and 
usefulness of the findings. It should be easier, as a result, to see what 
California students are able to do. Unfortunately, this method is so new in 
educational evaluation and assessment that guidelines and rule-of-th\imb bench- 
marks are not available. Each reader will have to evaluate the adequacy of 
the results. The emphasis is on establishing realistic and necessary levels 
of actual competence rather than on the traditional comparing of results to 
a national norm. 

How high is high ? It will be noted that most of the average percent correct 
scores hover around the 60s and 70s; however, some are down in the 30s, and 
some are up in the 90s. Two points must be kept in mind in intezrpreting 
these figures : , 

1. The major reason that the average scores are in the 60s and 70s, 

rather than the 90s, is that the aims of the instructional programs 
at each level in California schools go beyond the basic, minimal 
levels of performance expected of all students. In reading, for 
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example, those skills which are mastered by most students by the end 
of the second grade are not even tested in the sixth grade. Testing 
time is too valuable and the scoring and the processing too expensive 
to justlt)- gathering information which does not add to what is already 
known about California students. 

2. It should be obvious that high scores in particular subskiil areas 
do not necesssrM, effective protr^- y - ^ -rw scores, the 

opposite v.- 'Ttherently mor j = . reading, 

for exai,. .^.»^idered out?* . oy ne end of* 

grade three, nearly all students can inaneoi-ately recognize and read 
certain short words; nor is it at all disappointing that only about 
60 percent can answer certain questions requiring a student to recog- 
nize cause-and-effect relationships among sentences. 

Interpretations of experts . The overall results and especially the differences 
among various subcontent or skill areas have been reviewed by special advisory 
committees of highly respected educators in each field. It is Jioped that 
their comments about the adequacy of the findings and their discussion of the 
implications for shifts in program emphasis will be helpful both to the pro- 
fessional educator and the lay citizen concerned with education in California. 
Obviously, however, not all readers will agree with the opinions of the ^ 
specialists. Any discussion or inquiry which is stimulated by these opinions 
is useful in that it will help to clarify the proper objectives of the schools 
and foster realistic expectations of them. 
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III. Reading Achievement for Grades Two, Three, Six, and Twelve 



cf Findings 



California's second, third, and sixth grade pupils continued to show improvement 
in reading achievement from 1976-77 to 1977-78 and continued to score above the 
national average. Twelfth grade students, scoring below national norms, declined 
for a second consecutive year. Over the past 12 years, reading achievement test 
scores in grades two and three have shown slow but steady improvement. Second 
grade scores increasf^d slightly (0.5 percent correct) from 1976-77 to 1977-78; 
the medic:n second grade pupil is scoring at the 55th percentile ratic -5 points 
above the national average. Third grade scores increased 0.5 percent correct 
from 1976-77 to 1977-78, an increase which translated into a gain of 1 percen- 
tile point on national norms. The median third grade pupil now ranks at the 
57th percentile, 7 percentile points above the national average. 

Sixth grade reading scores also registered an increase (0.4 percent correct) 
from 1976-77 to 1977-78, resulting in a gain of 2 percentile points on national 
norms. Thus, the median sixth grade pupil moved from the 53rd to the 55*:h 
percentile rank--5 points above the national average. 

Twelfth grade reading scores declined (0.3 percent correct) from 1976-77 to 
1977-78; the median twelfth grade student is scoring at the 42nd percentile--8 
percentile points bilow the national average. 

Skill Area Strengths and Weaknesses 

The members of the Reading Assessment Advisory Committee reviewed the st ^te- 
wide 1977-78 reading results to determine strengths and weaknesses in the 
reading achievement of California students. While the presentation of skill- 
area strengths and weaknesses is based on the committee's judgments, the 
Department of Education accepts full responsibility for the conclusions in 
this report. 

Second and third grade results . The members of the committee were pleased to 
see the continuing upward trend in second and third grade reading achievement. 
The pattern of strengths and weaknesses discerned by the committee In the 
second and third grade reading results is summarized in Figure 1. 
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Figure 1 

Comnlttee Judgments of Second and llilrd Grade Skill Area Results 



Area of strength 


Area In need of Improvement 


Identifying sound~lctter cor~ 


ComDrehendlnc more crrnnlex sentience 


respondences 


s t "Tuc t lire s 


Identifying the meaning, of 


Understanding atfuctiiral relattLiii 


coauon words 


ships between words and sentences 




(such as following a pronoun or 


Comprehending shore, simple 


other uofd aiihat it'll re f»Ar»lf t'o "il'ti 


sentences presented outside a 


referent) 


paragraph 






Drawing Inferences from details 


Identifying explicit Information 


within a passage 


stated within a single sentence 




embedded In a short, tlmple 




paragraph 




Recognizing the main Idea of a 




short, simple paragraph 

1 





In response to the skill area needs presented in Figure 1, the committee 
suggested the following instructional emphases: 

• The meaning of conjunctions (such as and, or, but , and as ) in 
the context of a sentence 

• The relationships between words in complex sentences 

• The relationship between a pronoun (or other word substitute) 
and the word it refers to in sentences and paragraphs 

Some members of the comnlttee expressed concern over the slight decline 
registered in spelling patterns at the third grade. They endorsed the 
followirAg reconmendation, wl'ich was made by the English Language Assessment 
Advisory Committee as a key strategy for improving both spelling and reading 
performance at the elementary level: 

• Spelling should be taught systematically so that children 
are exposed to groups of words .which follow similar 
regular spelling patterns. If spelling is ti^^t in this 
orderly and structured way, pupils are more likely to 
internalise generalizations which apply to large groups 
of words* On the other hand, if children are exposed . 
only to random lists of words and spelling demons, it 
will be much ifiore difficult for them to discover the 
orderly nature of the English spelling system. 
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Sixth grade results. The members of the Reading Assessment Advisory Conmittee 
were pleased to see the gains rejdstered on the overall sixth grade reading 
results and In all the reading flkill areas from 1976-77 to 1977-78. The 
strengths and weaknesses discerned by the committee in the sixth grade reading 
results are presented in Figure 2. 



Figure 2 

Comm^^^'^o Ju<1cnn^ntfl ^ "^xth Grade Skill Area ' -isu! 



Area of strength 



Identifying explicit details 
within a passage 

Recognizing the main idea of a 
relatively easy paragraph 



Area in need of improvement 



Recognizing word meanings 

Comprehending more complex sentence 
structures 

Understanding structural relation- 
ships between words and sentences 
(such as following a pronoun or 
other word substitute back to its 
referent) 



The committee members concluded their analysis by recommending that the 
following language skills receive increased instructional emphasis: 

• Word study and vocabulary development (including word-forming 
skills involving the spelling, meaning, and use of words 
based on roots, prefixes, and suffixes) 

• Location of an idea within one or more sentence structures 
(including the relationship between an appositive and its 
referent and the relationship between a pronoun and its 
referent) 

The conmittee suggested that one very good instructional strategy for 
fostering the above skills is the sustained discussion and close examination 
of the langu&ge and detail of single selections read in class- Such sustained 
discussion of reading material should also provide students witl^ the opportu- 
nity to manipulate, interrelate, and evaluate ideas— skills needed for the 
higher level thinking processes involved In interpretive-critical comprehensioi 

Twelfth grade results. Members of the Feading A:ssessment Advisory Committee 
were disappointed to see a second year of declining twelfth grade reading 
scores. In their analysis of the test results, the members noticed a 
pattern which paralleled a number of points ^.rom the analyses of the grade 
six reading test results and the grade twelve written expression test results. 
This pattern of strengths and weaknesses is siammarized in Figure 3. 



2—78342 
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Figure 3 

Committee Judgments of TVelfth Grade Skill Arer» Results 



Area of strength 



dt:Lails in a variety of academic 
and everyday reading materials 

Recognizing the main idea of a 
paragraph 



Area in need of imprr 



recognizing word meanings 

Understanding structural relation- 
ships between words and sentences 
(such as following a pronoun or 
other word substitute back to its 
referent) 

Drawing conclusions from details 
within a passage 

Detecting the author's attitude 



The advisory committee concluded that the continuing decline in twelfth grade 
reading scores, especially in contrast to this year's increase in written 
expression, demonstrates the need for direct reading instruction at the high 
school level in English classes. This instruction should be reinforced by 
attention to reading skills in all the content areas. Guided by m under- 
standing of twelfth graders' strengths and weaknesses as highlighted above, 
members of the committee suggested the following instructional emphases: 

• Word-forming skills involving the spelling, meaning, and 
use of words based on roots, prefixes, and suffixes 

• Vocabulary development in all the content areas 

• The multiple meanings and connotations of words 

• Use of careful word choices to reveal feelings and 
attitudes and to create special effects 

m Use of context for deciphering word meanings 

• Relationships between words within sentences and para- 
graphs (such as relating a pronoun to its referent and 
relating a prepositional phrase to the woiJ it modifies) 

The committee recommended wide reading as the most effective method for helping 
students to increase their vocabulary and improve their comprehension skills. 
In addition, the committee recommended the sustained discussion of reading 
materials as a productive teaching strateg}'. Such discussions focussing 
on the details of word, sentence, and paragraph meaning are essential to the 
development of both vocabulary and comprehension skills. 
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Reading Results fot Grades Two and Three 



Test Scope 

The Reading Test; Second and Third Grades is the Instrument developed specifi- 
cally to assess reading achievement at the end of the second and third grades in 
California's elementary schools. It was designed to assess the students' attain- 
ment of a wide variety of objectives discussed broadly in Framework in Readin}^ 
for the Elementary and Secondary Schools of California (Sacramento: California 
State Department of Education, 1973) and specified, with the help of the Reading 
Assessment Advisory Committee, in Test Content Specifications for California 
State Reading Tests (Sacramento, California State Department of Education, 
1975), Both the objectives and the 250 test items that were used to assess them 
fall into one of six major skill areas: phonetic analysis, structural analysis, 
vocabulary, literal comprehension, interpretive-cr it ical comprehension, or 
St udy-loca t ional . 

Comparison of 1974-75, 1975-76> 1976-77, and 1977-78: Results, Grades Two and Three 

A summary of the results of second grade performance on the total reading test 
and in each of the major skill areas for 1974-75, 1975-76, 1976-77, arid 1977-78 
is shown in Table 2. Changes in performance from year ■ to year are also 
presented in Table 2. 

The following observations about changes in second grade reading achievement 
are evident from an examination of the data in Table 2. 

• For the third consecutive year, second grade reading 
scores improved on the Reading Test . The gain. from 
1976-77 to 1977-78 was 0.5 percent correct, resulting 
in an overall gain of 1.3 percent correct since 1974-75. 

• From 1976-77 to 1977-78 gains were shown In all reading 
skill areas. The greatest of these (1.5 percent correct) 
occurred in the study-locational skill area involving 
questions which required students to alphabetize words 
and use a table of contents. 

The results of third grade reading achievement for 1974-75, 1975-76, 1976-77, 
and 1977-78 are shown in Table 3. As was the case for grade two, changes 
in performance from year to year are presented in Table 3. 



table 2 



Statwlde Summary of Grade Two Reading Te st Results for 1974-75, 1975-76, 1976-77, and 1977-78 



Skill area 


Number of 
questions 


Average percent correct 


Change 


1974-75 


1975-76 


1976-77 


1977-78 


1974- 75 
to 

1975- 76 


1975- 76 
to 

1976- 77 


1976-77 

to 
19/7-78 


TOTAL READING 


250 


67.6 


67.7 


68.4 


68.9 


^.1 


40.7 


40.5 


Word Identification 


60 


75.4 


75.5 


76.2 


76.5 


40.1 


40.7 


40.3 


Sight words 


5 


83.9 


84.5 


85.4 


85.9 


40.6 


40.9 


40.5 


Phonetic analysis 


45 


76.5 


76.5 


77.1 


77.4 


-0- 


40.6 


40.3 


Structural analysis 


10 


65.8 


66.3 


67.5 


67.9 


40.5 


+1.2 


. 40.4 


Vocabulary 


60 


67.7 


67.6 


68.6 


69.1 


■0.1 


+1.0 


"40.5 


uuiupicucilo i,UIl 


Tin 


61.3 


61.3 


62.4 


62.8 


■0- 


+1.1 


40.4 


Literal 


77 


62.5 


62.3 


63.4 


•63.8 


-0.2 


+1.1 


40.4 


Interpretive 


33 


58.7 


59.1 


60.0 


60.4 


40.4 


44).9 


40.4 


Study-Locational 


20 


75.5 


77.2 


77.9 


79.4 


+1.7 


40.7 


+1.5 
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Table 3 

Statewide Summary of Grade Three Readloji Test Results for 1974-75, 1975-76, 1976-77, and 1977-78 



Skill area 


Niijnlipr of 


Average percent correct 


Change 


1974-75 


1975-76 


1976-77 


1977-78 


1974- 75 
to 

1975- 76 


1975- 76 
to 

1976- 77 


197L-77 

to 
1977-78 


lOTAL KfiiUlinb 




81.3 


81.4 


81.7 


82.2 


40.1 


■K).3 


40.5 


vvoru iUcniiiicaiiuii 


fin 


85.8 


85.6 


85.9 


86.3 


-0.2 


^.3 


40.4 


Sight words 


5 


92.7 


92.6 


92.9 


93.5 


-0.1 


40.3 


40.6 


Phnnptic analvsls 


45 


86.1 


85.9 


86.2 


86.5 


-0.2 


40.3 


40.3 


Structural analysis 


10 


80.9 


80.8 


81.1 


81.8 


-0.1 


40.3 


40.7 


Vocabulary 


60 


82.6 


82.9 


83.4 


8?. 9 


^.3 


40.5 


40.5 


Comprehension 


110 


77.0 


76.7 


77.1 


77.6 


-0.3 


40.4 


40.5 


Literal 


77 


77.9 


77.5 


78.0 


78.5 


-0.4 


40.5 


40.5 


Interpretive 


33 


74.9 


74.9 


75.0 


75.5 


-0- 


40.1 


40.5 


Study-Lccational 


20 


88.0 


88.0 


88.8 


89.6 


-0- 


40.8 


40.8 
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The following conclusions about changes in third grade reading performance 
(which are highly cousistenf with those for the second grade) are apparent 
from the results in Table 3i 

• For the third consecutive year, rhird grade reading 
achievement improved — by 0.5 percent in the last year. 
Added to the previous gains, this year's increase 
resulted in an overall gain of 0.9 percent correct 
since the first administration of the Reading Test in 
1974-75. 

• From 1976-77 to 1977-78 gains were registered in all 
reading skills areas. The largest gain occurred in the 
study-locational skill area (0.8 percent). 

Analysis and Interpretation of Skill Area Results, Grades Two and Three 

Members of the Reading Assessment Advisory Conmiittpe analyzed, interpreted, 
and evaluated the 1977-78 reading results. In this process they Weighed such 
factors as the inherent difficulty of the skills, the particular items used 
to assess each skill, and changes in performance since 1974-75. Guided by 
an understandir.g of the kinds of errors; pupils were making, the committee 
members concluded their analyses with iiQplications for instruction. 

Literal comprehension . The Reading Test is designed to measure -two broad 
categories of rea<iing comprehension. The first of these, literal comprehension, 
is defined as the locating or remeiubering of explicit elements -Stated in 
written material. , Thus, the 77 literal comprehension questions required 
second and third graders to identify the meaning of words, sentences, and 
short paragraphs. \' 

Members of the committee observed that scores were extremely high on a cluster 
of questions tliat required students to identify the meaning of an isolated 
sentence. 

The scores on the following test item were typical of both second and third 
grade performance on the sentience comprehension questions: 



Example A 
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ID 



The data on this question and others like it suggest that the vast majority of 
second and third graders have learned to read short, simple, isolated .sentences 
composed of easily decodable words. However, wh^n literal questions were 
based upon sentences contained within paragraphs (as is the case with most 
of the literal question?;), performance levels were somewhat lower. Example B ^ 
illustrates average ^performance in the literal comprehension category for both 
grades two and threi*. 



Example B 



Read the story and answer the questions. 

Susan had a dream. She dreamed she was 
a grocer. Her store was just like a 
real store, but she was a strange grocer 
She did not sell her groceries. She 
gave them away. The n^onle thankpH 
Susan by giving her tickets to the 
mflYl ftfl . ^oon she had many tickets, and 
she took many boys and girls to the 
movies . 

The people thanked Susan by 

Grade 2 Grade 3 
O saying "Thank you." (26) (16) 
# giving her tickets. (64) (79) 
O giving her flowers. (10) ( 5) 



In Example B choosing the correct answer required (l) locating the key 
sentence ( underlined here for the reader's convenience); and (2) identifying 
among the choices the answer that was given verbatim in the underlined 
sentence. VJliile this question is still a test of sentence comprehension 
(like Example A) a good deal of difficulty is added evidently once that 
sentence is embedded in a paragraph. On this more difficult .item, almost two- 
thirds of the secornd graders and just over three-fourths of the third 
graders responded correctly, as the data Reveal. Thus, it appears that ja, 
majority of second and third graders are ,ab^e ti>] handle the very basic, 
rote, verbat im kinds of literal comprehension questions derived from a 
sentence within a short, simple paragraph. 

Members of the committee observed that? additional difficulty arises**wheri 
pupils are required to draw relationships bfet:ween words in a sentence, or 
between sentences in a paragraph. Consider., for example, the following 
passage which contains all the information needed^ to answer the queistion ^ 
(underlined here for the reader's convenience). 

\ 



Example C 



Read the story and answer the questions, 



Father and Mother Seal lived in the cold 
North. They had a "puppy," as a baby 
seal is called. The seal family lived 
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on a big iceberg with cold water all 
around them. Mother Seal went down into 
the water to catch fish. ' Father Seal did 
not fish. He lived on the fat under his 
skin. Mother Seal taught her puppy to 
swim so he could catch his own food. 

In this story, the puppy is a little 
Grade 2 Grade 3 
Odog. (38) (22) . 

Ofish. ( 8) ( 4) 

• seal. (54) (74) 



To find the answer in this item, however, pupils must relate "puppy" and 
"baby seal*' by use of the conjunction "as," an operation that involves an 
understanding of a slightly more complex sentence structure. Over one- 
fourth of the third graders and almost one half of the second graders failed 
to demor^strate this understanding. Thus, members of the committee concluded 
that primary grade students need specific instruction in the meaning of 
conjunctions and the relationships between words in more complex sentence 
structures to ensure that pupils leaim to derive meaning from context clues 
as in Example C. 

,A test item that required students to relate the words from one sentence to 
those in another sentence is shown as Example D: 



Example D 



Read the story and answer the questions. 

Did you ever see a mouse that could fly? 
A bat is sometimes called a flying mouse* 

A bat is a furry animal. It has no 
feathers. Instead, its wings are made 
from skin. The skin stretches from the 
tips of its front legs to the tips of Its 
back legs. 

Some bats are as tiny as mice. Others 
can spread their wings nearly as wide as 
an eagle can. 

A bat is not like flying fish or flytn;^ 



squirrels. Those ap ^^nfllg glide only a 
little vav . But a bat is like birds and 
some insects. It can stay up in the air 
as long. as It wants to« 



Flying squirrels can 

Oglide as long as they want. 
• glh^e only a little way. 
Ofly'Jike birds. 
Qfly ^ke bats. 



Grade 2 Grade 3 
(17) (15) 
(50) (64) 
(19) (11) 
(14) (10) 

— 
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To find the answer in this item, the pupils had to put together two sentences 
(underlined here for the reader's convenience), a process that involved 
following 'Those anitoals" back to "flying fish and flying squirrels." As ^ 
IS apparant from the data, one-half of the second graders and over one- 
third of the third graders failed to accomplish this task. Thus, on the 
basis of scores on this question and others like it, members of the committee 
concluded that students would profit by more specific instruction and practice 
in recognizing the relationship between a pronoun or other word substitute 
and it^s antecedent . 

.Interpre tive-critical comprehension . ' Interpretive-critical comprehension is 
the second and higher level of reading. comprehension that the Reading Test 
IS designed to assess. Items in this area required the reader to use the 
explicit information in the reading material to reach a conclusion not stated 
in the material. Thus, the 33 interpretive-critical comprehension questions 
required pupils to make judgments, predict outcomes, infer main ideas, or 
draw some other kind of inference. 



Example E is one of the test items used to 
area: 



assess performance in this skill 



Example E 



Read the story and answer the questions. 

On:e there was a little boy who had a 
big problem. Every time the boy tried 
to talk his words came out backwards. 
Nc one could understand what he was 
saying! 

The little boy's parents took him to the 
best doctors in the country. The 
doctors could find no way to help the 
little boy. 

One night the little boy had a dream. 
He dreamed that if he walked backwards 
people would understand what he was 
saying. 

When he awoke the next morning he de- 
cided to see if his dream would come 
true. He walked backward to the kitchen. 
He spoke to his mother and father. 
Guess what? They could understand himi 

At the end of the story the little boy 



probably felt 

• happy. 
O unhappy. 
O angry. 
Osad. 



Grade 2 Grade 3 



(71) 
(15) 
( 4> 
(10) 



(85) 
( 6) 
( 3) 
( 6) 



2D 
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To find the correct answer in the above question, the pupils had to (1) compre- 
hend tlie story; and (2) infer how the outcome of the events would make the 
little boy feel. Thus, th^ item was a discriminating test of their overall 
comprehension of the passage. As the item data reveal, 71 percent of the 
second graders and 85 percent of the third graders handled this question 
successfully. 

While Example E required an understanding of the overall meaning of the story, 
the following test question required pupils to draw a conclusion from a piece 
of information presented within the paragraph. 



Example t 



Read the story and answer the questions. 

Most people believe that earthworms are 
of little use except for fish bait. But 
scientists have found that they are very 
Important. Earthworms eat soli. They 
make the soli better by grinding It up 
as It passes through their bodies. The 
holes that earthworms make as they burrow 
In the earth make It easier for tne roots 
of plants to enter the soil. Earthwoms 
use leaves ro line their underground 
homes. These leaves make the soli 
richer. Scientists have found that 
earthworms are the earth's plowmen. They 
keep stlrlng up the soil which helps to 
raise better crops. 

EErthv'o/n*s should have no trouble 
finding n^^^^ o Grade 3 



O crops. 



(10) 
(24) 
(56) 



CfiS-^t-rrn?:,. (10) 



( 7) 
(19) 
(67) 
( 7) 



Scores dropped considerably from Example E to Example F. These items 
Ulustrate a pattern that occurred in inferential comprehension at other 
grade levels as well; namely, that pupils seem to have less difficulty 
recognizing the overall meaning of a passage than they do inferring conclu- 
sions from details within a passage. A similar finding was also reported 
by the National Assessment of Educational Progress. 



Summary of Committee's Obser vations > Conclusions, and Recoimendatlons 

Members of the Reading Assessment Advisory Committee were gratified to see 
another year of improved reading achievement scores at the second and third 
grade levels. In the process of reviewing" the second. and third grade results 
item by item, the committee members reached the following conclusions: 



EKLC 
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1. The vast majority of second and third graders can identify 
the meaning of ohort, isolated sentences composed of 
easily decodable words (Example A). This was not unexpected 
since second and third grade performance on the relatively 
easy word identification and vocabulary questions was 
quite strong. 

2. A majority of second and third graders can locate and 
identify explicit information stated within a single 
sentence embedded la a. short, simple paragraph (Example 
B). The major obstacles to higher literal comprehension 
scores appear to be difficulties with more complex 
sentence structures and intersentence relationships 
(Examples C and D). 

3. Second and third grade pupils seem to have less 
difficulty recognizing the overall meaning of a 
passage than they do drawing inferences from details 
within a passage (Examples E and F) . 

After investigating the kinds of errors that pupils are making, members of 
the committee recommended the following be emphasized in instruction: 

• The meaning of conjunctions (such as and, or, but, and 

as) in the context of a sentence 

• The relationships between words in complex sentences 

• ITie relationship between a jpronoun (or other word 
substitute) and the word it refers to in sentences and 
paragraphs 

Some members of the committee expressed concern over the slight decline 
registered in spelling patterns at the third grade. They endorsed the 
following recommendation, which was made by the English Language Assessment 
Advisory Committee as a key strategy for improving both spelling and reading 
performance at the elementary level: 

• Spelling should be taught systematically su that children 
are exposed to groups of words which follow similar 
regular spelling patterns. If spelling is taught in this 
orderly and structured way,'' pupils are more likely to 
internalize generalizations which apply to large groups 
of words. On the other hand, if children are exposed 
only to random lists of words and spelling demons, it 
will be much more difficult for them tc discover the 
orderly nature of the English spelling system. 



Reading Results for Grade Six 



Test Scope 

The reading section of the Survey of Basic Skills; Grade 6 consisted of 128 
questions. The items were selected to assess the students* attainment of 
a wide variety of objectives disciissed broadly in Framework in Reading for 
the Elementary and Secondary Schools of California (Sacramento: California 
State Department of Education, 1973) and specified, with the help of the 
Reading Assessment Advisory Comnlttee, in Test Content Specifications for 
California State Reading Tests (Sacramento: California State Department of 
Education, 1975). Both the objectives and the questions used to assess 
them fall into one of five major skill areas: word identification, vocabu- 
lary, literal comprehension, interpretive-critical comprehension, and study- 
locational skills. The emphasis assigned to each of the reading skill areas 
in the Survey of Basic Skills: Grade 6 is presented graphically in Figure 4. 




(69 items) 

Fig. 4. Number of questions, by skill area, in the reading portion of the Survey of Basic Skiiis: Grade 6 



32 



Reading Results, Grade Six 
Comparison of 1975-76, 1976-77, and 1977-78 Results^ Grade Six 
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The results of sixth grade performance on the total reading test and in each 
of the skill areas for 1975-76, 1976-77, and 197)-78 are presented in Table 4. 
Year-to-year changes in overall performance and in skill area performance 
are also shown in the table. 



Table 4 



Reading Performance of California Sixth Grade Students 
on the Survey of Basic Skills: Grade 6 





Number of 
questions 


Average 


percent 


correct 


Change 


Skill area 


1975-76 


1976-77 


1977-78 


1975- 76 
to 

1976- 77 


1976- 77 
to 

1977- 78 


READING, TOTAL 


128 


66.1 


65.9 


66.3 


-0.2 


-K).4 


Word Identification 


18 


74.3 


74,2 


74.7 


-0.1 


-K).5 


Vocabulary 


25 


67.1 


66.3 


66.9 


-0.8 


+0.6 


Comprehens ion 


69 


64.9 


64.9 


65.2 


-0- 


+0.3 


Literal 


39 


67.4 


67.2 


67.5 


-0.2 


-H).3 


Interpretive- 
critical 


30 


61.8 


62.0 


62.2 


40.2 


-K).2 


Study- Iccational 


16 


60.0 


59 . S 


60.5 


-0.2 


+0.7 



The following observations about changes in achievement are evident from an 
examination of the data in Table 4: 

• From the sj)ring of 1977 to the spring of 1978, sixth grade 
reading teat scores Improved by 0.4 percent correct. This 
increase \/as twice as large as the decrease (0.2 percent 
correct) shown from the spring of 1976 to the spring of 1977, 
thus yielding an overall increase of 0.2 percent correct for 
the two-year period from 1975-76 to 1977-78. 

• From the spring of 1977 to the spring of 1978, increases were 
registered in all reading skill areas, the largest, of which 
occurred in study- locational skills (0.7 percent correct). 
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Analysis and Inter pretation of Skill Area Results 

The members of the Reading Assessment Advisory Conmittee analyzed, inter- 
preted, and evaluated the 1977-78 reading results. In this process they 
considered such factors as the inherent difficulty of the skills, the 
particular items used to assess each skill, and changes in perfo^nce 
since 1975-76. Guided by an understanding of the typical errors made by 
sixth graders, members of the committee concluded their analysis with in- 
structional recoranendations. 

Word identification . Most of the word identification questions on the Survey 
Of Basic Skills: Grade 6 were written to measure students' knowledge of 
suffixes, roots, and prefixes. Members of the Reading Assessment Advisory 
Committee have stressed in past reports the importance of teaching these 
1 o^l^^^^ building blocks to reading comprehension (see the 1975-76 and 
1976-77 annual reports of Student Achievement in California c;phno^« ^: There- 
fore, members of the committee were pleased to see the Improvement shown in 
this skill area from the spring of 1977 to the spring of 1978. However 
committee members were still not satisfied with the proportions of students 
responding correctly on these questions. They expected, for example, nearly 
all of the sixth graders to recognize the meaning of the prefix un on the 
following question rather than the 73 percent that did so: 



Example A 



The toga was a loose outer garment worn by 
Roman citizens when they appeared in public. It 
was made of a single broad piece of undyed 
woolen cloth, usually cut in the shape of a serr.i- 
circle. A large toga might contain from 10 to 20 
square yards of cloth. The toga was draped 
about the body with the straight side thrown 
nver the left shoulder. The help of a servant, and 
sometimes of more than one, was required to 
drape a large toga artfully. It was hervy and hot. 
and did not permit freedom of movement. 

Togas were usually white in color. Some men. 
especially candidates for public office, had the 
cloth bleached to make it extra white. On festive 
occasions army generals and certain public 
officials wore red or purple togas embroidered 
with gold thread. A Roman boy wore a purple- 
bordered toga until sometime between the ages 
of 12 and 16, when he put away the toga of 
childhood and put on the plain white toga of 
manhood. 
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We know from the prefix un in the word 
undyed that the woolen cloth was 

(DO dyed apart. 
( 7) Odyed back. 
(13) Odyed over again. 
(73) • not dyed. 



The conimittee concluded from the percent correct scores on questions such 
as this one that more emphasis is needed throughout the elementary grades 
on basic word -building skills (such as recognizing the meaning, use, and 
spelling of words with prefixes and suffixes). This judgment was corrobo- 
rated by the members of the English Language Assessment Advisory Comrpijftee 
in their analysis of sixth grade written expression and spelling results 
(se^ pages. 52-53) . 

Vocabulary . The 25 vocabulary questions on the sixth grade reading test 
required students to identify the meanings of words as they were used in a 
paragraph. Members of the cammittee were pleased to see the improvement in 
scores from 1976-77 to 1977-78. However, they judged that perfo.nnance in 
this area should still be higher. For example, fewer than th* .e-fourths of 
the sixth graders demonstrated an understanding of the common word skeleton 
in the following item: 



Example B 



(1/ What we usually call "sponges" are really 
only the dry skeletons of sponges. In life these 
were filled in and all covered over with the soft 
jelly-like flesh of living cells. When the live 
sponges are taken from fhe bottonn of the ocean, 
they look like pieces of beef liver. 

(2) Although classed as animals, sponges are 
like plants in many ways. They are always fas- 
tened to some object and never move about. 
They do not have eyes, or legs, or many of the 
other organs that animals usually have. Yet, 
sponges use the same method of feeding as ani 
mals, and also have the same type of egg cells. 

(3) Some sponges live attached to other ani- 
mals such as crabs. Fresh-water sponges live 
mostly on the underside of stones and floating 
objects. But it often happens that other animals 
make their homes in sponges. Sponges are never 
eaten by other animals, probably because sponges 
have a very disagreeable odor. 
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(4) Sponges are easily prepared for the mar 
ket. It takes about three days tor the flesh to 
decay away, and the skeletons are easily washed 
and cleaned. With a little trimming and sorting 
they are ready to be sold. Once widely bought, 
natural sponges have been largely replaced now 
by the factory-made cellulose "sponges/' which 
come in mjny pretty colors. People use both 
kinds of sponges for washing windows, washing 
cars, and soaking up spilled liquids. And some- 
times a sponge is used instead of a washcloth in 
bathir>g. 



The word skeleton means: 

(72) ^ananimars bones 
(12) O an animal's egg cells 
( 5) O an animal's home 
(11) O an animal's cellulose 



Some members of the committee were disappointed that the percent of students 
responding correctly on this item was so low. 

Furthermore, conmittee members observed low scores on some comprehension 
questions which were designed to assess knowledge of word meanings. The 
following is an example: 



Example C 



The toga was a loose outer garment worn by 
Roman citizens when they appeared in public. It 
was made of a single broad piece of undyed 
woolen cloth, usually cut in the shape of a semi 
circle. A large toga might contain from 10 to 20 
square yards of cloth. The toga was draped 
about the body with the straight side thrown 
over the left shoulder. The help of a servant, and 
sometimes of more than one, was required to 
drape a large toga artfully. It was heavy and hot, 
and did not permit freedom of movement. 

Togas were usually white in color. Some men, 
especially candidates for public office, had the 
cloth bleached to make it extra white..QDj£Stmfi. 
nrra<;;nns army QPnPraif; anri rprt|in pnhlir 
officials wore rftd or nurnip t«.^.s PmbrniriftrpH 
with gold thread. A Roman boy wore a purple- 
bordered toga until sometime between the ages 
of 12 and 16, when he put away the toga of 
childhood and put on the plain white toga of 
manhood. 
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Red togas were worn 

(26) O between the ages of 12 and 16. 

(36) • fo. celebrations. 

(12) O during childhood. 

(26) O when officials embroidered them. 



Careful study of Example C reveals that the question was based on one sentence 
(underlined here for the reader's convenience). Arriving at the correct an- 
swer required understanding the meaning of "festive occasions." Probably a 
lack of vocabulary knowledge hindered many students in their performance on 
this item. Thus, sixth grade achievement on a variety of vocabulary and com- 
prehension questions led the committee to conclude that more, intensive work 
in word study and vocabulary development is needed to ensu'^e maximal growth 
for elementary pupils in reading comprehension. 

Committee members were evem more concerned about the number of students who 
failed to make use of obvious and explicit content clues in deciphering word 
meanings, as in the following example: 



Example D 



Can bees see colors? If they can, color vision 
is probably useful to them. If bees can see 
colors, they probably find flowers more easily. 
Bees fly from flower to flower gathering nectar , 
a sweet substance used in making honey. In the 
process they transfer pollen from flower to 
flower. If it were not for the pollinating process, 
plants couldn't make seeds. 

To find out if bees can see color, some inves- 
tigators placed two squares of paper— one blue 
and one green— in the bottom of a cage of bees. 
They set a tiny dish on each square. They filled 
the dish on the blue square with a solution of 
sugar and water and left the dish on the green 
square empty. 

At first the bees landed on both squares. But 
soon they were all clustered on the blue square, 
feeding on the sugar water. After a while the in- 
vestigators emptied the dish of sugar water but 
left the dish in the cage. The bees still landed 
only on the blue square. Even when the squares 
were moved to different places in the cage, the 
bees went to the blue square. 



^ a— •^8342 
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The investigators knew, however, that many 
animals can't see color; they see things only in 
different shades of gray. Perhaps the bees could 
tell the squares apart because they saw green and 
blue as different shades of gray. The investi 
gators replaced the green square with many gray 
squares, each a different shade. On each gray 
square they put an empty dish; on the one blue 
square they also put an empty dish. As before, 
the bees landed only on the blue square. 



The word nectac means: 
% 

(77)<P a sweet substance 

(10) 0 honey 

(11) 0 pollen 
( 2)0 seeds 



Some members of the conmittee speculated that many students who missed this 
item may have been confused by the sentence structure since the context clue 
was presented as an appositive. The committee ijembers concluded that specific 
instruction in understanding more complex sentciace structures is likely to be 
an important strategy for helping children learn to take advantage of con*:ext 
clues. 

Literal comprehension . The Survey is composed of two broad categories of 
reading comprehension questions. Ihe first category, literal comprehension, 
is defined as identifying or remembering explicitly stated elements in the ^ 
material read. Most literal comprehension items asked students to identify ^ 
a single fact presented in the reading material, and several of these required 
fairly close reading and careful discriminations. Members of the committee 
observed that most students did very well on basic, straight-forward, literal 
questions dealing with isolated details, as in the following example: 



Example £ 



ERIC 



A new kind of star is shining over New York 
City. It is at the top of a tall, steel tower on an 
office building. It can be seen from a distance of 
five miles and tells by changing its color what 
kind of weather New York City is going to have. 

Clear weather is coming if the star is green. 
Orange means the weather will be cloudy. If the 
star is flashing orange. New York children wear 
rubbers and raincoats because rain is on the way. 
When the star is flashing white, snow is on the 
way and children get out their sleds. This is the 
most modern way to predict what the weather is 
going to be. For a long time radio and newspapers 
were the principal sources of information con- 
cerning the weainer. Now a new way has been 
found. 
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How would you like to have a star tell you 
when you can go on your picnic? Maybe the star 
will tell you the weather is unsuitable and you 
will have to eat your picnic lunch inside. 



A green star shining atop the building means 

( 4) O children should wear their hoots. 

( 2) O snow. 

(91) • clear weather. 

( 3) O children should get out their sleds. 



All of the information needed to answer this question is contained within a 
single sentence (underlined in the passage for the reader's convenience). 
However, the following question, based upon the same passage, proved to be 
more difficult: 



ample F 



What can be seen from a distance of five miles? 



( 6) O New York City 

(13) OA steel tower ' 

( 5) O An office building 

(76) CI A new kind of star 



This question was derived from the first three sentences of the passage 
shown in Example E. The literal comprehension task in this item involved 
relating the word "It" in the third sentence to its referent, "A new kind 
of star," in the first sentence. Thus, while over 90 percent of the students 
were able to answer successfully the question in Example E, which was based 
upon one sentence, only about three-fourths of the students successfully 
related words from sentence to sentence in Example F. Thus, some conmltte^ 
members concluded that more intensive and specific instruction in helping 
students understand and follow relationships between words (as from the 
pronoun to its referent in Example F) is a key strategy for inq)roving com- 
prehension on almost all reading materials which involve conventional para- 
graph development. 

The committee felt that one of the best instructional strategies for accom- 
plishing this purpose is the sustained discussion of details and their rela- 
tionships within reading material. In this sort of discussion, students might 
learn to focus on those cues essential to comprehending all written English 
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Interpretive-critical comprehension . The second broad category of compre- 
hension questions appearing on the Survey is a higher level of reading skill 
interpretive-critical (or inferential) comprehension. In Interpretive- 
critical comprehension, a reader uses the explicit informrition in a passage 
along with his or her personal experiences and thinking abilities to predict 
generalize, compare, judge, infer, and create ideas. Thus, the 30 interpre- 
tive-critical comprehension questions on the Survey required students to 
glean from a passage some conclusion that was not explicitly stated. As one 
might expect, the questions in this skill area were more difficult for stu- 
dents than those in any of the foregoing skill areas. The average percent 
correct in this area was 62.2. 

Since sixth graders have shown slight increases for two consecutive years 
in this typically difficult skill area, members of the committee were gener- 
ally pleased by the results. The following test item Is an illustration of 
the type of skill being assessed in the area of interpretive-critical compre 
hension: 



Example G 



My name is James, same as my father's. My 
mother calls me Jimmy. MV father is called Jim. 
He always wakes me up in the morning. He calls 
me Jim. I hope I'm like him when I grow up. 

My father works as a plumber's helper, and 
for extra money, he is a night watchman. Mother 
says that Daddy works very hard to make us 
hajtey, and Daddy says the same thing about 
Mdlher. Both Daddy and Mother say that we 
make them happy because we are their children. 

On Sunday we all go to church together-my 
father, mother, my older sister, and my younger 
brothers, Jerry and Willie, and !. When we come 
home, we have a good dinner. We have fun on 
Sundays. Daddy and Mother don't have to go to 
work then. They have time to play with us or 
take us for a ride in the car. 



Vou can tell from the story that James is the 

( 9) O oldest child. 

(73) 1^ second oldest child. 

(10) O third oldest child. 

( 8) O youngest child. 
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Members of the ccnnmlttee concluded that the sustained discussion of reading 
material In class Is likely to be profitable In terms of Interpretlve-crltlcal 
comprehenslpn as well as literal comprehension. Such Instruction would pro- 
vide students with the opportunity to manipulate. Interrelate, and evaluate 
Ideas. 



Suiaaarv of Comnlttee's Conclusions and RecomneTiidatlons 

The members of the Reading Assessment Advisory Connlttee were pleased to see 
the gains registered on the overall sixth grade reading results and In all 
the reading skill areas from 1976-77 to 1977-78. They were especially pleased 
with the gains made for two consecutive years on the questions assessing the 
higher level reading skills, Itfterpretlve-crltical comprehension. 

They observed that most sixthr graders can perform successfully on very basic, 
straight -forward, literal questions dealing with Isolated details and main 
Ideas based upon relatively easy material. Performance starts to drop off 
as soon as the questions begin to place demands upon students' knowledge of 
word meanings, understanding of more complex sentence structures, and ability 
to follow the relationships between words and sentences. 

After reviewing the kinds of errors made by sixth graders on the reading test, 
members of the conmittee Identified the following language skills as critical 
areas In need of more specific Instructional emphasis because they are key 
building blocks to the mastery of reading and writing skills : 

• Word study and vocabulary development (Including word-forming 
skills involving the spelling, meaning, and use of words based 
upon roots, prefixes, and suffixes) 

• Location of an idea within one or more sentence structures (in- 
cluding the relationship between an appositive and its referent- 
see Example D — and the relationship between a pronoun and its > 
referent— see Example E) 

Members of the comnittee added that recent research findings suggest that one 
very good instructional strategy for fostering the above skills is the sustained 
discussion and close examination of the language and detail of single selections 
read in class. Such sustained discussion of reading material should also pro- 
vide sttidents with the opportunity to manipulate, interrelate, and evaluate 
ideas— skills needed for the higher level thinking processes involved in in- 
terpretive-critical comprehension. 



Reading Results for Grade Twelve 



Test Scope 

' The reading section of the Survey of Basic Skills; Grade 12 consisted of 141 
questions. The items were designed to assess the students* attainment of a 
wide range of objectives discussed broadly in Framework in Reading for the 
Elementary and Secondary Schools of California and specified, with the help of 
the Reading Assessment Advisory Committee, in Test Content Specifications for 
California State Reading Tests . As shown in Figxire 2, both the objectives 
and the questions used to assess the achievement of the objectives fall into 
one of four reading skill areas: vocabulary, literal comprehension, interpre- 
tive-critical comprehension, and study-locational skills. Figure 5 is also an 
illustration of the emphasis placed on each of the reading skill areas in the 
Survey of Basic Skills; Grade 12 . 




Fig. 5. Number of questions, by skill area, in the reading portion of the Survey of Basic Skttb: Gmde 12 
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Comparison of 1975-76, 1976-77, and 1977-78 Results^ Grade 12 

The results of twelfth grade performance on the total reading test and in 
each of the skill areas for 1975-76, 1976-77, and 1977-78 are presented in 
Table 5. Year-to-year changes in overall performance and in skill .rea * 
performance are also shown in the same table. 



Table 5 

Reading Performance of California Twelfth Grade Students 
on the Survey of Basic Skills, Grade 12 





Number of 
questions 


Average 


percent 


correc L 


Change 


Skill area 


1975-76 


1976-77 


1977-78 


1975- 76 
to 

1976- 77 


1976- 77 
to 

1977- 78 


READING, TOTAL 


141 


64.1 


63.6 


63.3 


-0.5 


-0.3 


Vocabulary 


31 


61.3 


60.9 


60.5 


-0.4 


-0.4 


Comprehens ion 


97 


64.5 


63.9 


63.7 


-0.6 


-0.2 


Literal 


47 


69.2 


68.9 


63.5 


-0.3 


-0.4 


Int erpr et ive- 
critical 


50 


60.1 


59.3 


59.2 


-0.8 


-0.1 


St udy-locat ional 


13 


68.4 


67.2 


67.3 


-1.2 


+0.1 



The following observations about the changes in twelfth grade reading achieve- 
ment are evident from an examination of the data in Table 5: 

• For the second consecutive year, twelfth grade reading 

achievement declined. The decrease from 1976-77 to 1977-78 
(0.3 percent) was slightly less than the decrease of the 
previous year (0.5 percent), yielding an overall decline 
of 0.8 percent correct. , 

t From 1976-77 to 1977-78, slight declines were registered in 
all reading skill areas except in the area of study-locational 
skills, where a slight increase of 0.1 percent correct was 
registered. 



Analysis and Interpetation of Skill Area ResultSt Grade 12 

The members of the Reading Assessment Advisory Committee reviewed the 
twelfth grade results item by item as they did for the other grade levels. 
The conmittee identified some basic kinds of reading exercises that most 
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twelfth grader, performed successfully as well as some types of questions 
which revealed recurring patterns of diff ^.culty. Members of the committee 
concluded their analysis with recommendations for reading instruction. 



Li t er al compr eh ens ion . The first broad category of reading comprehension 
skills assessed by the Survey was literal comprehension, defined as remembering 
or locating elements stated explicitly in a reading selection. The 47 literal 
comprehension questions required students to demonstrate their understanding 
of what they read by selecting either a restatement or paraphrase of words, 
sentences or paragraphs. 



A few of the literal questions on the Survey required students to identify 
ar isolated fact from materials one might have to read in everyday life (such 
as an automobile insurance policy, a recipe, and directions for treating 
poison ivy). Example A is a literal comprehension test item, including the 
percent of students who chose each possible answer. 



Example A 



POISON IVY 



The interval for burning, itching, and finally 
water filled blisters to appear varies a great deal. 
This, again, may depend on some differences in 
human skins and the symptoms of dermatitis 
can develop within a few hours or even days 
later. The most important factor in using any 
remedy or treatment is TIME. Unless you can 
wash the poisonous sap away within 5 to 10 
minutes after exposure, you are likely to be in 
trouble. Wash the entire body at once with any 
bland soap and then change clothing which must 
be laundered before being worn again. It is, of 
course, very obvious that washing is not always 
possible immediately after known contact with 
such irritating plants, and a tub or shower after 
outdoor activity is generally too late to avoid 
dermatitis if you have been exposed to or in 
contact with poison ivy. The blister fluid asso- 
ciated with ivy poisoning does not spread the 
irritation; but it is the oily, poisonous resin which 
is transferred to other skin areas by rubbing or 
scratching. 

There are some simple preparations for treat- 
ment of ivy poisoning. An easily prepared 
"remedy" can be made by using equal parts of 
baking soda and cornstarch with enough water 
to form a paste or a lotion. Wet packs of boric 
acid are helpful in case of severely poisoned 
eyelids and swollen eves. Calamine lotion can be 
used to soothe the discomfort of itching, burn- 
ing skin. Preparations containing iron salts are 
likely to cause permanent tattoo effects, espe- 
cially if skin in th? area of application is broken. 
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What should you do if the ivy poisoning 
affects your eyelids? 

( 6) OApply calamine lotion. 
( 1) OApply iron salt solution. 
( 2) OApply mild soap solution. 
(84) •Apply wet packs of boric acid solution. 
( 7) OApply a paste of baking soda and corn- 
starch. 



Similarly, 90 percent of the students identified the length of baking time 
from a recipe, 85 percent determined the method of cooking from the same ' 
recipe and 94 percent found the maximum amount per person for which an 
insurance policy would cover medical bills. Moreover, on the majority of 
literal questions based upon academic materials (historical, scientific, and 
literary selections) scores of at least 70 percent correct were obtained. 
Thus, members of the conmittee concluded that most twelfth graders can perform 
successfully on ll^ ral questions requiring them to locate isolated facts or 
details from everyaay and academic reading materials. 

In the further examination of questions with low percent correct scores, 
some members of the committee observed that a weak grasp of vocabulary 
appeared to be a source of difficulty for many twelfth graders (as It was 
for sixth graders). For example, the following item in Example B reveals 
that over one-half of the students did not understand the meaning of the 
word ''famished" in this passage. 



Example B 



Skiing has recently become one of the 
more popular sports in the United States. 
Because of its popjjiarity, thousands of 
winter vacationers are flying north rather 
than south. In many areas, resen/ations are 
required months ahead of time. 

I discovered the accommodation shortage 
through an unfortunate experience. On a 
sunny Saturday morning I set out from 
Denver for the beckoning slopes of Aspen, 
Colorado. After passing signs for other ski 
areas, I finally reached my destination. 
Naturally I lost no time in heading for the 
nearest tow. After a stimulating afternoon of 
miscalculated stem turns I was famishftri 
Well, one thing led to another and it must 
have been eight o'clock before I concerned 
myself with a bed for my bruised and aching 
bones. 
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il It took precisely one phone call to ascer- 
tain the lack of lodgings in the Aspen area. 
I had but one recourse. My auto and I 
started the treacherous jaunt over the pass 
and back towi>rd Denver. Along the way, I 
vyent begging for a bed. Finally a jolly inn- 
keeper took pity and for only thirty dollars 
a night allowed me the privilege of staying in 
a musty, dirty, bathless room above his 
tavern. 



In paragraph II, "famished" means: 

( 2) Omorose 
(53) o tired 
(43) ♦hungry 
( 2) Qhopeful 



The disappointing score on Example B and on a variety of other vocabulary 
questions led members of the conmittee to conclude that students need more 
instruction in vocabulary development, including the multiple meanings and 
connotations of words, the use of context, and vocabulary in the content 
areas. To accomplish this, the committee added, students need to be en- 
couraged to read widely and need to be motivated to keep learning new words. 

Twelfth grade performance on the following vocabulary item, tested without 
a narrative context, is revealing in a different way: 



Example C 



Parallel to the horizon 



(67) <p horizontal 
(17) O vertical 
( 5) O diagonal 



O base 
O meridian 



4) 
7) 



The scores on this question lead to two conclusions: (1) the obvious one, 
that over 30 percent of the twelfth graders do not know the meaning of the 
word horizontal: and (2) the more instructive one, that those unsure students 
failed to make use of the cue in the definition, the word horizon, which is 
the root of the word horizontal , Membets of the committee recommended that 
the increased instructional- emphasis in vocabulary development include a 
word -building conqponent involving the spelling, lise, and meaning of words 
based upon roots, suffixes, and prefixes. Members of the English Language 
'Assessment Advisory Committee reached the same conclusion after reviewing 
the twelfth grade results in spelling and written expression. /' 
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Literal comprehension is more than a knowledge of word meanings, however. 
It also involves the ability to follow the relationships between words, 
relationships that are signalled by striicturaL cues within sentences and 
paragraphs. For example, many twelfth graders were still displaying conf 
sion on questio.ns which required them to follow the relationship between 
pronoun and its referent. The following question is an illustration of 
this difficulty: 



Example D 



After two weeks of unusually high-speed tra- 
vel we reached Xeno, a small planet whose popu- 
lation, though never before visited by Eaithmen, 
was listed as "friendly" in the Intet^tellar 
Gazetteer. 

On stepping lightly (after all, the gravity of 
Xeno is scarcely more than tw:ce that of our 
own moon) from our spacecraft we saw that 
"friendly" was an understatement. We were 
immediately surrounded by Frangibles of var- 
ious colors, mostly pinkish or orange, who held 
out their "hands" to us. Imagine our surprise 
when their "hands" actually merged with ours as 
we tried to shake them! 

Then, before we could stop them (how could 
v;e have stopped them?), two particularly pink 
Frangibles simply stepped right into two~emi^ 
nent scientists among our party, who immediately 
lit up with the same pink glow. While occupied 
in this way, the scientists reported afterwards, 
they suddenly discovered that they "knew" a 
great deal about Frangibles and life on Xeno. 

Apparently Frangibles could take themselves 
apart atomicaliy and enter right into any other 
substance. Thev communicated by thought 
waves, occasionally merging "heads" for greater 
clarity. Two Frangibles who were in love with 
each other would spend most of, their time 
merged into one; tney were a Diuisn-green coior 
unless they wer^'ljaving a lovers' quarrel, when 
they turned gra/ ^ 




How did the Frangibles communicate? 

; 3) OBy lighting up ( 9)0 By changing color 
( 1) OBy sign language O By-shaking "hands" 
(79) •By thought waves ( 8) 
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A correct response on this item involves recognizing that "They" refers to 
the "Frangibles"; otherwise, the answer to the question is presented verbatim 
in one sentence (underlined here for the reader's convenience). The difficulty 
students are having in following such relationships between words is probably 
contributing to the error rate on this relatively easy item. Example E 
illustrates a somewhat similar kind of difficulty. 



Example £ 



The Director of the FBI wrote an article for the 
March 8, 1975, issue of TV GUIDE XhaX started 
like this: 

At 9:40 p.m. last July 24, as the House Judi- 
ciary Committee debated Presidential impeach- 
ment charges before millions of television 
viewers, a bomb threat came into the Capito! 
switchboard. The hearing room was cleared and. 
during the precautionary search, newspeople 
quite properly reported the threat to vast net- 
work audiences. 

A television newsman commented, somewhat 
stoically I thought, to the effect that "Simply 
by reporting it, we may well be encouraging 
someone else to telephone a bomb threat." 

The newsman was correct. Beginning that 
evening there were seven tel ephoned threats to 
obliterate the Committee, all apparently 
generated by the instant, nationwide exposure 
given the initial threat. <y 



The news about the first bomb threat was 
reported over television 

(14) Oas the threat was being called in. 
(24) Oas the room was being cleared of people. 
(56) •during the search for the possible bomb. 
( 6) Oafter it had been determined that there was 
no bomb. 



On this item students needed to recognize that the phrase "during the pre- 
cautionary search" modifies the word "reported" and thus indicates that the 
search and the reporting were going on. at the same time. The data on this 
question suggest that many students failed to comprehend this structural 
clue. 
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After reviewing student performance on Examples D, E, and others like them, 
members of the committee concluded tliat students need specific instruction 
designed to help them understand relationships between words, sentences, and - 
paragraphs in their reading. One way to accbiiq)llsh this' goal is through 
suscained discussion that examines closely the language and detail in the 
material being read in class. 

Interpi^tive-critical comprehension . A higher level reading skill, interpretive- 
critical comprehension is assessed, by 50 questions pn the Survey . In interpretive- 
critical comprehension, a reader uses the explicit information in the, selection 
to make predictions, form generalizations, reach conclusions, make comparisons, 
form judgments, and create new ideas. All other things being equal, interpretive- 
critical comprehension questions should be more difficult than the purexy literal 
because the reader is required to make inferenc2s. 

This proved to be the case on the Survey of Basic Skills; Grade 12, on which 
students averaged 59.2 percent correct in the interpretive-critical skill area 
(in contrast to 68.5 percent correct for the literal). As in the literal 
category, scores in interpretive-critical comprehensifon have' declined slightly 
for two consecutive years. ^ 

Members of the committee ob^served that twelfth graders were typically more 
successful at drawing inferences about the main idea or entire meanine of a 
passage than they were at making inferences from details within a passage 
^his pattern is illustrated by the following two tes-^ items based on the 
same selection: J 



Example F 



The thirty years from 1455 to 1485 were a 
period of almost constant civil war between the 
supporters of two branches of the royal family— 
the house of Lancaster and the house of York. 
This fighting is usually called the Wat of the 
Roses, because the house of Lancaster had d red 
rose as its badge, and the house of York a white 
rose. At the end of it, Henry Tudor, who be- 
longed to the Lancaster branch of the family, 
came to the throne as Henry VIL He married 
Elizabeth, who belonged to the York branch, 
and thus helped to heal the wounds of the 
prolonged conflict. Its chief lesult was the wiping 
out of many noble families and the reduction 
of the power of these lords and barons so that a 
king could have his own way without much 
trouble. 
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Example G 



Henry Vll's reign (1485-1509) was a time of 
rebuilding for England. He kept order in the 
country and strengthened the royal power by 
special courts and economical management. In 
his reign John Cabot made his famous trip across 
the Attantic-the first of modern Europeans to 
see the continent of North- America where 
ColurriDus had reached only the Carribean 
IslancJv Henry's economy is seen in the entry in 
his diary when Cabot came back: "To hym that- 
found the new isle, £10"-less than fifty dollars 
for discovering a continent—but of course Henry 
didn't know how important this discovery was 
going to be in the history of England. 

A conclusion that can be drawn from this 
passage is that 

( 7) Othe position of king of England was weaker 

after the War of the Roses. 
( 3) Oexplorers were handsomely paid in the time 

of Henry VII. 
( 4)OHenry VII was a navigator beftore he 

became king. 

(86) ♦Henry VII lived in a time of conflict and 
exploration. 



According to the passage, Henry VII ruled at 
the time of 

<29) Oa revolution against the nobility. 
(31) Othe settlement of New England. 
(26) •the voyages of Columbus. 
(14) Othe destruction of the house of York. 



Example F required students to demonstrate an understanding of the primary 
message of the material; whereas Example .G required them to find a detail 
relating to the time period in the passage, and relate it to basic historical 
knowledge concerning the voyages of Columbus. While 86 percent of the twelfth 
graders succeeded o i the former task, just over one-fourth of them successfully 
managed the latter. 
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Reading Results, Grade Twelve 
The National Assessment of Educational Progress reported a similar finding: 

. . . individuals appear to be much more capable of drawing 
inferences about the entire meaning of a passage than they 
are of making specific inferences from phrases or sentences 
within a passage. ( Reading in America; A Pprc=n ^.^-^^» on 
Two Assessments. Reading Report No. 06-R-Ol, October, 1976.) 

Some interpretive-critical questions required students to infer the author's 
attitude or purpose. The ability to answer this kind of question correctly 
involves being aware of the way an author chooses words to create a parti- 
cular feeling toward the topic. This critical reading skill is central to 
Identifying the mood or tone of a selection as well as to detecting propa- 
ganda devices. The following item is an illustration of this kind' of reading 



Example H 



III 



Skiing has recently become one of the 
more popular sports in the United States. 
Because of its popularity, thousands of 
winter vacationers are flying north rather 
than south. In many areas, reservations are 
required months ahead of tirne. 

I discovered the accommodation shortage 
through an unfortunate experience. On a 
sunny Saturday morning I set out from 
Denver for the beckoning slopes of Aspen, 
Colorado. After passing signs for other ski 
areas, I finally reached my destination. 
Naturally I lost no time in heading for the 
nearest tow . After a stimulating afternoon of 
miscalculated stem turns I was famished. 
Well, one thing led to another and it must 
have been eight o'clock before I concerned 
myself vyith a bed *or my bruised and aching 
bones. 

It took precisely one phone call to ascer- 
tain the lack of lodgings in the Aspen area. 
I had but one recourse. My auto and I 
started the treacherous jaunt ovar the pass 
and back toward Denver. Along the vyay, I 
went begging for a bed. rinally a jolly inn- 
keeper took, pity and for only thirty dollars 
a night allowed me the privilege of staying in 
a musty, dirty, bathless room above his 
tavern. 



Si 
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The author's love for skiing is suggested in 
which paragraph(s)? 

(11) Ol ( 8) O I and II 

(4A) • 1 1 (35) O None of the paragraphs 

( 2) O Ml 

— -U- 



Key words revealing the answer to this quest iqja are underlined • 

As the item data reveal, less than half of the twelfth graders answered thiiJ 
question correctly. The low performance on this item and others like it may 
be related to the declining scores in language choices at both grades six and 
twelve (discussed in Chapter V under "Written Expression Results for Grades 
Six and Twelve"). Thus, evidence from both reading and written expression 
test results suggests that elementary and secondary students would profit 
from intenpiified instruction in the way in which deliberate word choices in 
writing can reveal the author's feeling toward the topic. 

Summary of Committee's Observations, Conclusions, and Recommendations 

Members of the Reading Assessment Advisory Committee were disappointed to see 
a second year of declining twelfth grade reading scores. In their analysts of 
the test results, they discerned the following pattern of strengths and 
weaknesses (which paralleled a number of points from the analyses of the grade 
six reading test results and grade twelve written expression test results) : 

c> 

• A majority of twelfth graders can identify isolated facts and 
details from a variety of academic and everyday readxng materials. 
The two major obstacle.^ jco higher literal comprehension scores 
appear to be (1> difficulty in recognizing word meanings in 
context, or through prefix, root or suffix clues (see Examples 

B and C) and (2) difficulty in following such structural clues 
as pronoun references and prepo&?itional phrases (see Examples 
D and E) . 

• Twelfth graders are typically more successful at inferring the 
main idea or overall/ meaning of a selection than they are at 
drawing cone lusioprS from details within a passage (see Examples 
F and G) . This jf'indlng was also reported by the National 
Assessment of Educational Progress in a report on national 
reading performance. 

J Many twelfth graders are not adept at detecting the ways in 
which authors reveal their feelings toward a topic through 
careful word choices (see Example 11). This finding is all the 
more significant i^^ light of the decline in the written expres- 
sion skill area of language choices at both grades six and 
twelve. 
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The advisory committee concluded that the continuing decline in twelfth 
grade reading scores, especially in contrast to this year's increase in 
written expression, demonstrates the need for direct reading instruction 
at the high school level in English classes. This instruction should be 
reinforced by attention to reading skills in all the content areas. Guided 
by an understanding of twelfth graders' strengths, weaknesses, and error 
patterns, members of the committee suggested the following instructional 
emphases: 

• Word-forming skills involving .the spelling, meaning, and 
use of words based on roots, prefixes, and suffixes 

• Vocabulary development in all the content areas 

• The multiple meanings and connotations of words 

• Use of careful word choices to reveal feelings and 
attitudes, and to create special effects 

• Use of context for deciphering word meanings 

• Relationships betv ien words within sentences and para- 
graphs (such as relating a pronoun to its referent and 
relating a prepositional phrase to the word it modifies) 

The committee recommended wide reading as the most effective method for 
helping students to increase their vocabulary and Improve their comprehension 
skills. In addition, the committee recommended the sustained discussion of 
reading materials as a productive teaching strategy. Such discussions 
focussing on the details of word, sentence, and paragraph meaning are essential 
to the development of both vocabulary and comprehension skills. 
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IV- Written Expression Achievement for Grades Six and Twelve 



Synopsis of Findings 

Both sixth and twelfth grade written expression achievement scores in 
California improved slightly from 1976-77 to 1977-^78. Sixth grade written 
expression scores have registered improvement every year since 1974-75 when 
the Survey of Basic Skills was first administered. From 1976-77 to 1977-78 
sixth grade written expression scores again showed a slight gain (.5 percent 
correct). The median sixth grade student is scoring at the 51st percentile— 
one point above the national aveiage. 

Between 1969-70 and 1974-75 the median twelfth grade student in California 
dropped steadily from the '2nd percentile to the 32nd percentile on national 
norms in written expression. In 1975'-76 cue median student moved up to the 
34th percentile, in 1976-77 back to the 33rd percentile, and this year back 
up to the 34th percentile~lo points below the national average. See Chapter 
VIII, "Comparisons with. National Normsj" for details. 

Skill Area Strengths and Weaknesses 

The members of the English Language Assessment Advisory Committee were 
pleased to see the. gains made by both sixth and twelfth. graders in w-ltten 
expression from 1976-77 to 1977-78. The committee membets analyzed the 
test results to identify strengths and weaknesses in skill area performancei 
Tney concluded their, analysis ^ith instructidnal recommendations. 

While the discussion of skill area strengths and weaknesses is based on 
the committee's judgments, the Department of Education accepts full responsi- 
bility for the interpre tat ions in this report. 

S ixth Grade Results 

After reviewing the written expression results for grade six students, the 
English Language Assessment Advisory Committee concluded that sixth graders 
displayed a respectable command of severar^fundamental written expression 
skills, while they exhibited a need for increased instruction in others. 
Their conclusions are summarized in the following Figure: 
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Figure 6 



Committee Judgments of Sixth Grade Skill Area Result 



Area of strength 


Area in need of ^lnornv*lmont• 


Selecting the correct form of a 
word for a sentence 


Spelling words with suffixes 


Selecting the correct verb or 
pronoun according to standard 
English usage 


\ 

1 Capitalizing the days of the 

week and months of the year 


Discriminating between complete 
and incomplete sentences 


j-uentirymg the most specific or 
general word in a group of 
words 

Selecting a word which is most 
likely to convey a particu- 
lar feeling or attitude 



The committee offered the follov^ing instructional recommendations for the 
sixth grade written expression skill areas that they judgedio S need 
of increased instructional emphasis: J B to oe xn need 

^' approach to teaching spelling is needed at the 

elementary level. Children should be exposed to homogeneous groups 
of words (words that follow similar spelling patterns) so thaf 
, they can more easily internalize spelling zener^U^.tL . 

more emphasis in the generalizations pertaining to the spelling 
of words with suffixes. If students fall to ^form such basic 
generalizations in the third and fourth grades, where they 
are first introduced, these lesfi^ons should be retaught, reviewed 
ad practiced in the fifth and sixth grades. reviewed, 

2, Some of the simplest capitalization rules pertaining to days 
of the week and months of the year need to be retaught and 
stu^e^rslls"; the fourth, fifth, and sixth grades. Intemediate 
students also need more specific instruction In the skill of 
identifying all the words In a multiple word proper noun and 
recognizing tliat all of them must be capitalized: 

3. Focussed instruction and skill-building practice are r.eeded in the 
language choices skill area to help pupils understand some of tSe 
issues related to effective word choices. Pupils need ^h^c ..oh! 
standing if they are to write effectively, read crSlLnv ^ l~ 
alert to propaganda devices in all the media "'""^^^y* ^^"'^ 



48 



Student Achievement In California Schools 



Twelfth Grade Results 

The committee discerned a pattern of strengths and weaknesses In the twelfth 
grade results which corresponded to the sixth grade pattern at several 
points. Tnc twelfth grade pattern is summarized in Figure 7 below. 

Figure 7 

Committee Judgments of Twelfth Grade Skill Area Results 



Area of strength 


Area in need of improvement 


Selertlnp the correct form of a 


Spelling words with suffixes 


word for a sentence 




Dlcjrriminatint between complete 


Inserting punctuation in sentences 




where a knowledge of a rule or 




convention is necessary 


Inserting punctuation in sentences 


Recognizing the most specific or 


where the sound of spoken 


general word in a group of 


English could be used as a 


words 


guide 






Selecting a word which is most 




likely to convey a particular 




attitude or emotion 




Identifying basic grammatical 




elements in sentences 




Recognizing the most effective 




and concise statement of an 




idea 




Achieving coherence in paragraphs 



In response to some of the weaknesses identified in the twelfth grade written 
expression results, the coinnittee recommended the following instructional 
practices: 

1. A skill naintenance program in spellinr* for junior and senior high 
school students is needed. Such a program should involve a highly 
str-jctured approach to spelling instruction, wbxch would introduce 
words grouped according -o spelling generalizations, particularly 
generalizations that apply to the formation of new words by the addition 
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of suffixes to a base word. This kind of structure, coupled with 
appropriate practice, should enable students to learn a number of 
highly useful generalizations which can be applied to many other words. 
More time and especially more efficient and specific instruction should 
be devoted to the spelling needs of Junior and senior high students. 

Intermediate and secondary students should have more experience and 
especially more focussed instruction in a number of areas related to 
effective language choices in writing. These areas include the degree 
of specificity of a word and the emotional tone conveyed by a word in 
a particular context. The Reading Assessment Advisory Committee (which 
found that many twelfth grade students displayed confusion on some of 
the reading questions requiring them to detect the author's emotion or 
attitude in a selection) concurred that students need more focussed 
Instruction in the language choices skill area. 

Specific and sequential instruction in a variety of paragraph skills 
(including stating ideas in a logical sequence, using transitions, and 
achieving c ons is tency olf verb tense and pronoun reference) i s needed at 
the secondary level. Such instruction In paragraph skills should be re- 
inforced by the detailed examination and discussion of written material 
through sustained clascroom discussions. Members of the Reading Assessment 
Advisory Committee concurred with the English Language Assessment Advisory 
Committee In feeling that the intensive study of paragraphs skills Is 
likely to increase reading comprehension as well as improve coherence in 
student writing. 



Written Expression Results for Grade Six 



Test Scope 

The written expression section of the Survey of Basic Skills: Grade 6 consists 
of 128 questions. The items were selected to assess the students* achievement 
of a broad array of objectives compiled by the English Language Assessment 
Advisory Comnittee and published in Test Content Specifications for the Survey 
of Basic Skills; Written Expression and Spelling, Grades Six and Twelve 
(Sacramento: California State Department of Education, 1975). Both the 
objectives and the items used tc assess the objectives fell Into one of seven 
major skill areas: word forms, language choices, standard usage, sentence 
recognition, sentence manipulation, capitalization, and punctuation. The 
relative degree of emphasis assigned to each of the t/ritten expression skill 
areas on the Survey of Basic Skills: Grade 6 is presented graphically in 
Figure 8. 




Fig. 8, Number of^questions, by skill area, in the written expression section of the Survey of Basic Skiiis, Grade 6 

5S 
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There are also 64 spelling questions on the Survey of Basic Skills; Grade 6 . 
Of these, 35 items tested pupils' spelling knowledge of both predictably 
spelled words and spelling demons; the other 29 items tested pupils' know- 
ledge of common spelling patterns used in word forming when suffixes and pre- 
fixes are added to words. 



Comparison of 1975-76, 1976-77, and 1977-78 Results, Grade 6 

The results of sixth grade performance on the total written expression test 
and in eacb of the skill areas for 1975-76, 1976-77, and 1977-78 are presented 
in Table 6. Year-to-year changes in overall performance and in skill area 
performance are also shown in the table. 



Table 6 



Statewide Mean Scores on the Written Expression Portion of 
the Survey of Basic Skills: Grade 6 , 1975-76 through 1977-78 



Skill area 


Number of 
questions 


Average percent 


correct 


Change 


1975-76 


1976-77 


1977-78 


1975- 76 
to 

1976- 77 


1976- 77 
to 

1977- 78 


WRITTEN EXPRESSION, TOTAL 


128 


62.5 


63.6 


64. 1 


+1.1 


+0.5 


Word forms 


16 


82.4 


82.3 


82.9 


-0.1 


-1^.6 


Standard usage 


16 


75 3 


75.3 


75.0 


0.0 


+0.5 


Language choices 


26 


54.4 


56.5 


55.2 


+2.1 


-1.3 


Sentence recognition 


22 


62.3 


63.0 


63.7 


+0.7 


+0.7 


Sentence manipulation 


16 


61.7 


62.6 


63. 1 


+0.9 


+0.5 


Capitalization 


14 


57.4 


58.4 


59.8 


+1.0 


+1.4 


Punctuation 


18 


52.4 


52 '5 


54.4 


+0. 1 


+1.9 


SPELLING, TOTAL 


64 


63.6 


63.6 


64.1 


0.0 


+0.5 


Relationships 


35 


58.1 


58.1 


58.6 


0.0 


+0.5 


Word forming 


29 


70.2 


70.3 


70.8 


+0. 1 


+0.5 



The following conclusions are apparent from an examination of the data in 
Table 6; 

• Fo^ the second year sixth grade performance in written 
expression improved. The increase from 1976-77 to 
1977-78 (0.5) was about half as great as the increase 
between 1975-76 and 1976-77 (1.1), yielding an overall 
increase of 1.6 percent correct for the three-year 
period. 
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• From the spring of 1977 to the spring of 1978, gains were 
made in all skill areas except language ciioices, which 
registered a decline of 1.3 percent correct (see Examples 
H and I for illustrations of language choice questions). 
The skill area registering the largest increase during this 
time span was punctuation. 



Analysis and Interpretation of Skill Area Results. Grade 6 

Members of the English Language Assessment Advisory Conmittee analyzed, 
interpreted, and evaluated the 1977-78 writt*>n expression results, as 
they have done in previous yearc. In judging the adequacy of student per- 
formance, they considered such factors as the inherent difficulty of the 
skills, the particular items that were used to measure each skill, and changes 
in performance since 1975-76. Guided by an understanding of the kinds of 
errors students are making, the committee concluded their analysis with 
recommendations for instruction. 

Spelling . The 64 spelling questions on the Survey of Basic Skills; 
Grade 6 were designed to assess students* knowledge of regularly spelled 
words, spelling demons, and words formed by the addition of prefixes or 
suffixes. The following example is a typical spelling item from the Survey . 



Example A 



Fill in the oval next to the MISSPELLED 
word in each group. If there is no 
misspelled word, the answer is "All 
correct." 



( 1) O clean 

(66) ^ breaze 

( 2) o please 

(31) o All correct 



In their analysis of the spelling results, members of the committee were dis 
turbed by percent correct scores on a number of test words involving the 
addition of a suffix to a base «?ord, as in the following examples: 



Example B 



Pairs of words are given below. In 
each pair, one word is spelled cor- 
rectly, and the other is spelled in- 
correctly. Fill in the oval next to 
the pORRECT SPELLING. 



(20) O forgeting 
(80) • forgetting 
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Example C 



(37) 


O 


careing 


(63) 




caring 



The conmittee judged that the scores on these and similar items were un- 
necessarily lov since each of these words illustrates a highly regular and 
predictable generalization about how a word is spelled when a suffix is 
attached to it. The members concluded that spelling should be taught in a 
systematic and structured way (preferably through the use of a spelling text) " 
so that students are exposed to clusters of words which follow a particular 
spelling pattern (rather than merely exposing children to a list of regular 
and irregular words in every lesson). In this way students are more likely 
to internali7 : spelling generalizations that apply to large groups of words. 
The committee added that if studeats fail to master some of the banic spelling 
generalizations related to suffixes in the third and fourth grades where they 
are first introduced, these lessonr should be retaught, reviewed, and practiced 
in the fifth and sixth grades. 

Punctuation and capitalization . The 18 punctuation items on the Survey of 
Basic Skills; Grade 6 equired pupils to identify errors in the conmion uses 
of the period, question mark, exclamation point, comoia, apostrophe, and 
quotation marks. 



While punctuation remained the most difficult skill area on the sixth grade 
written expression test, with an average percent correct score of 54.4, it 
was also the skill area showing^the largest gain from 1976-77 to 1977-78. The 
following example is an illustration of both the upward trend over the years 
and the average performance in this skill area. The set of scores accompanying 
the example refers to this one item only. 



Example D 



The following sentences may have a mis- 
take in punctuation (periods, conraas, 
apostrophes, etc.). When you find a 
mistake, fill in the oval next to the 
line with the mistake. If there is no 
mistake, fill in the fourth oval. 

( 5) O This summer we are 

(54) • going to Hollywood California 

( 4) O for at least three days. 

(37) O (No mistakes) 



Percent Correct 

1975- 76 48.3 

1976- 77 51.7 

1977- 78 54.2 



The 14 capitalization questions on the Survey required pupils to recognize 
the parts of a sentence containing words needing capitalization. While 
members of the committee were pleased to see the considerable gains made by 
sixth graders in c^.pitalization, they judged that scores were still too low 
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on questions involving days of the week and months of the year. The 
coiitnlttee expected the vast majority of sixth graders to recognize that a 
day of the week should be capitalized; however, only about 60 percent of the 
pupils did so on the following question and others like It: 



Example E 



In the following sentence you are to 
look for mistakes in capitalization. 
When you find a mistake, fill in the 
oval next to the line with the mistake. 
If there is no mistake, fill in the 
fourth oval. 

(64) • On monday my 

( 5) O brother always rides 

( 4) O his bicycle to school. # 

(27) O (No mistakes) 



Members of the comnlttee also observed that many sixth graders capitalized 
only the first word of a proper noun involving more than one word, a fact 
which suggests that a large number of students need a better grasp of the 
concept of a proper noun. 

Word form s^ standard usage, and language choices . The 16 word form questions 
on the Survey required students to select the correct form of a word for a 
blank in a given sentence. Hils skill area continued to be the easiest one 
on the test, with an average percent correct score of 82.9, The following 
word form question Illustrates the typically high performance in this skill 
area. 



Example F 



Fill in the oval next to the word or 
words that best fit each sentence. 



The flag was still 

( 2) o wave 
( 6) o waves 
(91) • waving 
( 1) O had waved 



over Fort Ross, 



One can see by comparing Example F with Examples B and C that while most 
pupils can select the correct form of a word for a sentence, fewer pupils 
can spell the new form of the word correctly. Thus, it appears that in most 
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cases, the chief difficulty for students in adding suffixes to words lies in 
spelling- the new form of the word rather than in recognizing or using it. 

The 16 standard usage questions on the Survey required students to select 
the form of a verb or a pronoun that is considered correct according to 
standard English usage. A majority of students continued to respond cor- 
rectly to questions of this type, such as the following example: 



Example G 



r 



Fill in the oval next to the choice 
t?i£.t is correct for each sentence. 



The doctors, 

(82) • did 
(18) O done 



.everything possible. 



While members of the coniaittee were quite pleased with the scores and progress 
shown in the areas of word forms and standard usage questions, they were some- 
what concerned about the decline registered in language choices from 1976-77 
to 1977-78. The language choices area is designed to test students' skill in 
making careful word choices for different purposes. For exanple, some questions 
required students to select the most specific and vivid word for a sentence 
while other language choices questions required students to select a vord re- 
flecting a particular emotional tone in a given context. Examples ci both 
kinds of language choice items follow. 



Example H 



Pretend that you are writing a story. 
Fill in the oval next to the word or 
words that will give your reader the 
clearest , most specj.f ic and concrete 
picture. 

EXAMPLE: 

At the bottom of her lunch sack 
she found . 

0 some food 

C a carrot 

0 a snack 

0 a vegetable 



I could smell 



.cooking. 



(66) €^ bacon and eggs 
( 9) O a hot meal 
(10) O some good food 
(15) O breakfast 
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Example I 



Fill in the oval next to the word or 
group of words that answers the 
question. 

Which of the following best shows that John's 
anitude was unfriendly? 



"Where are nny bat and ball?"_ 



John. 



( 8) O called 
(20) O said 
(57) 9 grumbled 
(15) O exclainned 



Members of the conmittee expressed concern Sout the declining scores on such 
questions because understanding the special effects created by word choices 
in written English is an important writing and reading skill. Ihey were 
particularly concerned about the decline in scores on language choice items 
registered by twelfth graders since the conmittee' s expectations were higher 
for seniors on this more refined skill area. 

The conmittee also observed what appears to be a related weakness in the 
twelfth grade reading results. On a number of reading test items that re- 
quired students to identify the emotion created by the word choices in a 
piece of writing, scores were quite low. Since language choices cropped up 
at different grade levels and in different content areas as a weakness, mem- 
bers of the committee reconmeoded more intensive instruction in this skill 
area. Tliey recommended focussed instruction that would require students to 
make word choices according to degrees of specif icity and particular emotional 
effects. The committee also suggested that teachers migjit construct some 
practice exercises parallel to the sample items shown in the interpretive 
supplements and Test Content Specifications as one possible strategy for pro- 
viding students with such skill-building practice. As is stated in the 
English Language Framework^ "Practice in making the best word choice for 
precision and clarity should be regarded as important to each writing ex- 
perience." 

Sentence recognition and sentence manipulation . The 22 sentence recognition 
questions required pupils to identify complete sentences, incomplete sentences, 
run-together sentences, and sentences in normal English word order. The com- 
mittee was pleased to see the consistent progress shown by sixth graders in 
sentence recognition. Example J is a typical sentence recognition item. (The 
data reflects both average oerformance in this skill area and the upward trend 
registered for sentence recognition since 1975-76.) 



1 Eiiglish Language Framework for Cal i fornia Public Schools ^ 

Sacramento: California State Department of Education, 1976. p. 45. 
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Example J 



Fill in the oval next to the group of 
words which needs more words to mke 
it a complete sentence. 

(12) O They brought a present. 
(17) O We are happy.' 
( 9) O Barry is not here. 
(62) • In the dark of the night. 



Percent Correct 

1975- 76 58.7 

1976- 77 61.1 

1977- 78 62.2 



A close examination of Example J suggests that many pupils relied more 
heavily upon the length and sound of a word cluster that upon its structure 
in determining the completeness of a sentence. The committee was not dis- 
couraged by this, however, since an emphasis on grammatical structure is 
often delayed until junior high school. 

Most of the 16 sentence manipulation questions required pupils to select 
the most effective sentence or sentence element, a skill that involves rec* 
ognizing the clearest, most concise, and most direct way of expressing a 
statement. The following example is illustrative: 



Example K 



Beneath each sentence you will find four 
ways of writing the underlined part. 
Choose the answer that would make the 
best sentence, and fill in the oval 
next to it. The first answer is always 
the same as the underlined part and is 
sometimes the correct answer. 

Besides selling candy, flowers and greeting 
cards are also sold by Mr. Grog. 

(15) O Besides selling candy, flowers and 
greeting cards are also sold by Mr. 
Grog. 

(24> O Not only candy, but Mr. Grog sells 
flowers and greeting cards too. 

( 7) O Candy as well as flowers and greeting 
cards, too, all of these are sold by Mr. 
Grog. 

(54) • Mr. Grog sells not only candy, but 
flowers and greeting cards as well. 



Since this and other questions in the sentence manipulation category tend 
to be relatively subtle and sophisticated for sixth graders, members of the 
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coDinlttee were pleased that performance was this high and that slight in- 
creases were shown for sentence manipulation as a vhole. 

Sunmary of Conmittge's Findings and ReconHnendations 

Members of the English Language Assessment Advisory Conmittee were gratified 
to see a second year of increasing sixth grade written expression scores. In 
their analysis of the test results, conmittee members discerned the following 
pattern of strengths and weaknesses, a pattern that paralleled a number of 
points from the analysis of twelfth grade written expression results: 

• A majority of sixth graders can handle basic written 
expression skills such as the following: (1) selecting 
the correct form of a word for a sentence (Example F) ; 
(2) selecting the form of a verb or pronoun considered 
correct according to standard English usage (Example G) ; 
and (3) discriminating between complete and incomplete 
sentences (Example J) . 

• Weaknesses occurred in the following skill areas: 

(1) spelling words with suffixes (Examples B and C) ; 

(2) capitalizing the days of the week and months of 
the year (Example E) ; (3) identifying the most specific 
or general word in a group of words (Example H) ; and 
(4) selecting a word which is most likely to convey a 
particular emotion (Example I), 

Guided by an understanding of sixth graders' strengths, weaknesses, and most 
frequent mistakes, members of the conmittee offered the following instructional 
reconmendations : 

1. A more efficient approach to teaching spelling is needed 
at the elementary level. Children should be exposed to 
homogeneous groups of words following similar spelling 
patterns so that they can more easily Internalize gen- 
eralizations that apply to many other words as well. Such 
instruction should include more emphasis in the general- 
izations pertaining to the spelling of words with suffixes. 
If students fail to form such basic generalisations in the 
third and fourth grades, where they are first introduced, 
these lessons should be retaught, reviewed, and practiced 
in the fifth and sixth grades » 

2. Some of the simplest capitalization rules pertaining to 
days of the week and months of the year need to be re- 
taught and reinforced in the fourth, fifth, and sixth 
grades. Intermediate students also need more specific 
instruction in the skill of identifying all the words in a 
multiple word proper noun and recognizing that all of them 
must be capitalized. 
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Focussed instruction and skill-building practice are needed 
in the language choices skill area to help pupils understand 
some of the issues related to eff€:::tlve word choices. Pupils 
need this understanding if they are to x^itc effectively, 
read critically, and be alert to propaganda devices in all 
the media. 



Written Expression Resu.?ts for Grade Twelve 



T est Scope 

The written expression section of the Sui-vey cf Basic Ski l ls; Grade 12 
consists of 142 questions. The iteais were selected to aSi^ess the students' 
attainment of a vide variety of objectives compiled by the English Langtiage 
Assessment Advisory Committee and published in Test Content Specifications 
for the Survey of Basic Skills^ Written E:q)ression and Spelling, Grades Six 
and Twelve, Both the objectives and the items used to assess^ the achieve- 
ment of the objectives fell into one of six major skill areas: word forms, 
language choices, sentence recognition, sentence manipulation, paragraphs, 
and capitalization and punctuation. The emphasis placed on each of the 
written expression skill areas in the Survey of Basic Skills: G rade 19 is 
shown in Figure 9. 




Fig. 9. Numbei <*f questions, by skill area, in the written expression section of the Survey of Bssic Skills Grade 12 

6j 
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There are also 72 spelling questions on the Survey of Basic Skills; Grade 12 < 
These items tested students' knowledge of predictably spelled words, spelling 
demons, and words with prefixes and suffixes. 



Comparison of 1975-76, 1976-77^ and 1977-78 Results, Grade Twelve 

The results of twelfth grade performance on the total written expression 
test and in each of the skill areas for 1975-76, 1976-/7, ani 1977-78 are 
presented in Table 7. Year to year changes in overall performance and in 
skill performance are also shown in the table. 



Table 7 

Statewide Mean Scores on the Written Expression Portion of the 
Sun/ey of Basic Skills; Grade 12 , 1975-76 through 1977-78 





1 

Number of 
questionp 


Average 


percent 


correct 


Change 


Skill area 


1975-76 


1976-77 


1977-78 


1975- 76 
to 

1976- 77 


1976- 77 
to 

1977- 78 


WRITTEN EXPRESSION, TOTAL 


142 


62.3 


61.9 


62.1 


-0.4 


40.2 


Word forms 


24 


72.6 


, 72.1 


72.1 


-0.5 


-0- 


Language choices 


32 


66.9 


66.7 


66.6 


-0.2 


-0.1 


Sentence recognition 


20 


67.3 


67.7 


6C.4 


+0.4 


+0.7 


Sentence manipulation 


12 


42.9 


42.9 


43.4 


-0- 


+0.5 


Paragraphs 


26 


59.9 


59.1 


59.3 


-0.8 


+0.2 


Capitalization and 
punctuation 


28 


54.6 


54.3 


54.7 


-0.3 


+0.4* 


SPELLING, TOTAL 


72 


68.0 


67.9. 


68.4 j 


-0.1 


+0.5 



The following observations about cnanges in performance are apparant from an 
examinatica of the results in Table 7. 

• Twelfth grade performance in written expression improved 
slightly (0.2 percent) from 1976-77 to 1977-78. This small 
gain, however, did not completely offset the loss (0.4 percent) 
from the previous year, yielding 3 slight overall loss (0.2 
percent) from 1975-76 to 1977-78. 
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From 1976-77 to 1977-78 gains were registered in all skill 
areas with the exception of language choices, which 
suffered slight decline (0.1 percent) and word forms, 
which remained stable. The largest gain over this time 
period was in the area of sentence recognition (0.7 percent) 



Analysis and Interpretation of Skill Area Results, Grade 12 

The X977-78 written expression results for grade twelve were reviewed, 
interpreted and evaluated by the English Language Assessment Advisory 
Conmittee as were the sixth-grade results. In th.iir analysis of the 
reraits, the conmittee members considered the inherent difficulty of 
the skills, the particular items that were used to measure each skill, 
and changes in performance since 1975-76. Guided by an understanding of 
the difficulties students were having, the conmittee concluded theiv 
analysis with a number of instructional recommendations. 

Spelling. The seventy-two que-^tions in the spelling section were designed 
to measux.e students' knowledge of the spelling of regularly spelled words, 
spelling demons, and words with suffixes. The average percent correct, score 
for this category was 68.4. The following item illustrates the way in which 
spelling was assessed on the grade twelve Su rvey . 



Example A 



In each of the following sentences, one 
word is underlined and is written in 
BOLD TYPE. Fill in the o\al, next to 
"right" if the word is spelled corrP'^^-ly 
or next to "wrong" if ttte word is 
spelled incorrectly. 

ft 

What did you do on the Forth of July? 
O Right • Wrong 

(2.'/ (73) 



Members of the committee observed the same kind of sp^elling problem in the 
twelfth grade results as they had reported in those for the sixth grade, 
namely difficulties \rLth the spelling of k word once a suffix had been 
attached. The following items illustrate \this difficulty: 



Example B 



He discoverd a new method of communication. 
O Right •Wrong 



((5 7) 



(43) 



Example C 



Our school offers a course in creative writting. 
O Right •Wrong 
(38) . (62) 
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h!f f!*i!^ ^^he ':oimnittee were disturbed to see that so many twelfth graders 
had failed to learn some of the most basic rules for adding suffixes to 

over'hi^ro^T"*^^' ? ^""^ V: ""^^ particularly surprised to see that 

over half of the students indicated that "discoverd" was correctly 
spelled. 

On the basis of these and similar data, the committee recommended a skiJl 
maintenance program in spelling for junior and senior high school students. 
Such a program may well employ a highly structured approach to spelling 
instruction which would introduce words grouped according to spelling 
generalizations, particularly general izatious which apply to the formation 
of new words when suffixes are attached to a base word. This kind of 
r^uL'er\f°MM "^^^^PP"P^i^^^ P^f"i" should enabJs students to icarn 
wordf ^ J "'^^"^ generalizations which can be applied to many other 

words. The conmittee members added that a new spelling series with heavy 
emphasis on taese basic word-forming generalisations is needed at the jSIior 
high level. Thus, more time and especially more efficient and specific 
Sg^^'students '° spelling needs of junior anS senior 

^^ thrsecond"'' Punctuation and capitalization continued to 

be tne second most difficult written expression skill area for twelfth graders 
on the Survey as the average percent correct score of 54.7 in Table 7 Suct 
Performnce has been remarkably stable in this skill area over the years with 
a slight upward gain (0.4 percent correct) from 1976-77 to 1977-78 Se 
scores on the questions varied considerably. Tlie following question is an 
example of an item in which about three-fourths of the seniors responded 
correctly: ' 



Example D 



In the following sentence which 
punctuation is needed? 

We visited Taliesen West Frank Lloyd Wright's 
famous home in the desert. 



(76)* West, Frank 
(15)0 Visited, Taliesen 
( 2; O famous, home 
( 7) O home, in 



Members of the committee have observed th it many more students nerfo.™ ^ 

successfully on questions where punctuation coincided ll^ r^ 

junctures of spoken English (as L Example DK H^^ver ^e^: st^d^i v . 

dro;::d'"7^'''^°f/ — - - gu'ide/the p^rlen^ ^rrecrscor": 
dropped substantially as is illustrated in the following exampL- ' 
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Example E 



In each sentence there may be an error 
in capitalization or punctuation. The 
error, if any, is underlined and 
lettered. If there is an error, select 
the one underlined part that must be 
changed to make the sentence correct. 
If there is no error, the answer is D. 

"Mice, as well as other pets, need some peace 

and quiet, but_they should[nt be left entirely 
A B 

alone/' advised Dr. Cranej_^the veterinarian. 

C 

No error 



OA 
( 9) 



(59) 



O C 
(11) 



O D 
(21) 



The scores on this question also illustrate the difficulty which students 
evidently have at all grade levels with apostrophe usage— in both contrac- 
tions and possess ives. 

Word forms and lan^^uage choices . Most of the 24 word form questions on the 
Survey required students to select the correct form of a word for a sentence 
and to demonstrate a variety of dictionary skills for different purposes. 
As a whole this category continued to be the easiest for twelfth graders. 
For example, the vast majority of students selected the correct form of a 
word for a sentence as the following item illustrates: 



Example F 



Sslect the form of the word which best com- 
pletes the following sentence. 

The girl did her work very / 



( 1)0 cheerfulness (7)Ocheerful 
(92)0 cheerfully ( 0)0 cheer 



Thus, as was true for sixth graders, the difficulty for twelfth graders in 
using suffixes seems to be in spelling different forms of a word correctly, 
rather ttian in selecting the correct form of the word for use in a sentence. 
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The thirty-two language choice questions required students to identify 
attitude-conveying words and phrases, to differentiate between specific 
and general words, and to identify the intended audience of a piece of 
writing. Langtaage choices is the one written expression skill area on the 
Survey that has shown a decline for two years in a row. This was also the 
only skill area to register a decline from 1976-77 to 1977-78 in the sixth 
grade written expression results. The following are examples of two kinds 
of skills assessed by -th^^ language choice questions: 



Example G 



Dr. Henrv J. Heimlich, 



at Jewish Hos 



pital in Cincinnati, described the technique in 
the journal Emergency Medicine and invited 
physicians to try it in real emergencies. 

Which of the following terms.is most respectful 
in the context of the above sentence? 

(62) ••director of surgery 

1) O chief blade 
(17) O practitioner 
(20) Ohead doctor 



Example H 



Which of the following words or groups 
words is most SPECIFIC? 

(33) O current events magazine 

( 5)0 publication 

(55)^ Ne\A/sv\/eek 

( 7)0 magazine 



The connnittee members were particularly concerned over both the low level 
of scores and the declitie of scores on questions IV the one shown as 
Example H. This kind of skill is one of considerable concern to the 
committee since student writing typically suffers ^-cm a lack of specifi- 
city. Such generality and vagueness in student writing may result from the 
fact thnt many students cannot even tell a specific word from a general word 
when presented with both. 

As is stated I'ji the English Language Framework -^; "Students should recognize 
varying degrees of abstraction in words as well as degrees of generality in 
words by being exposed to continued experience in understanding that a word 
like car is more general than' Pinto, and that abstract words like love, honor. 



Ibid ., p. 48. 



> 
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and truth are emotion-arousing, highly abstract, and general; therefore, 
meaning different things to different people." 

The committee recommended more focussed instruction in language choices to 
supplement instruction in this area. Such focussed instruction should 
require students to make careful word choices biased upon such factors as the 
degree of specificity, and the emotioxi^onveyed by a particular word (as, 
for example, by developing exercises parallel to the language choice 
questions in the Test Content Specif ications) ♦ 

Sentence recognition and sentence manipulation . The twenty sentence recogni- 
tion questions required students to identify complete sentences, sentence 
p2rts, sentence patterns, and the appropriate subject-verb relationship. 

Sentence recognition continues to be the second easiest written expr^ession 
skill area on the Survey for twelfth graders, and it is the only skill area 
to have registered an increase for two years in a low (0.4 and 0.7 percent), 
rhese increases may reflect a renewed focus on the sentence in the return to 
the basics. However, twelfth grade scores still varied gro.atly in the 
sentence recognition skills depending ofi the complexity of the question being 
asked. For example, over two-thirds of the students were able to identify the 
incomplete sentence in the following question: 



Example I 



Identify the group of words which is incom- 
plete or needs additional words to complete 
the meaning. 

^70) •T barking dog in the driveway. 

( 6) Olt is humid. 

(18) OPeace continues. 

( 6) OThere is the mail. 



The error pattern for Example I suggests that maiiy students relied more 
heavily upon the length of a word group than upon its structural components 
in determining the completeness of a sentence. Tlie responses to the next 
example also indicate that over one-third of the twelfth graders are, indeed, 
confused about some of the basic grammatical elements of a sentence. 



Example J 



The 



man seems V9ry_ 



The part of speech that wf!i usually fill both 
blanks in the sentence abOv'e is: 

(12) O a noun (62) ♦an adjective ^ 
(18) O a verb ( 8) Oa pronoun 
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Many twelfth grade students failed to demonstrate the ability to discriminate 
between effective and ineffective sentence style. Students continued to 
prefer awkward, indirect, wordy, and choppy sentences, often in the passive 
voice, to simple, direct, concise statements. The following example is an 
illustration of this difficulty: 



Example K 



Beneath the following sentence you will 
find four ways of writing the underlined 
part. Choose the answer that makes the 
best sentence, and makr the oval in 
front of the answer you have chosen. 
The first answer is the same as the 
underlined part and may be the correct 
answer. 

On Sunday we bathed the dog, which he 
needed very badly. 

(40) obathed the dog, which he needed very 
oadly 

( 5) obathed the dog, which he very badly had 
need of 

(48) ^gave the dog a badly needed bath 

( 7) ogave the dog a bath, being badly needed 



As members of the committee have observed in previous years, high school 
seniors do not equate effective writing with conciseness. 

Paragraphs . The 26 paragraph questions on the Survey required students to 
identify irrelevant sentences, recognize inconsistent verb tenses, determine 
logical sequences, select summary statements, and identify transitional 
words within one or more paragraphs. 

Although scores on the paragraph section improved in the past year, twelfth 
graders failed to compensate completely for the decrease in paragr?ph 
skills scores registered from 1975-76 to 1976-77. Members of the committee 
expx^essed concern about any line on these questions, which assess 
students' inderstanding of the relationships between sentences and paragraphs. 

The following questions, based on the same paragraph, are illustrative: 



Example L 



The seven sentences below are in a scrambled order. 
Some of tiiem can be put together to make a single, 
unified paragraph- Before attempting to answer any 
questions, read all of the sentences carefully. 
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A 1 It probably received its name from its 

2 copper-colored head which is triangular 

3 in shape. 

B 4 Like the rattlesnake, it is a member of 

5 the pit viper family having a hollow or 

6 pit between the eye and the nostril. 

C 7 The copperhead was once the most common 

8 and widely distributed of all venomous 

9 snakes in the United States. 

D 10 This may be the reason that Democrats in 

1 1 the North who sympathized with the South 

12 in the Civil War were called "copperheads," 

13 for they were suspected of treachery. 
E 14 Unlike the rattlesnake, it has no rattles 

15 and strikes without warning. 
F 16 Augustus Thomas wroie a full-length drama 

17 that he called The Copperhead. 
G 18 Today, however, it is most frequently 

19 found in sparsely settled areas of the 

20 South. 

Which sentence most logically follows Sentence 
C? 

(18) OSentence A (14) OSentence E 
(10) OSentence B (58) •Sentence G 



Example M 



Whid» of the following words serves as a transl- 
tionai word in the paragraph? 



(15) Owhich (line 2) 
(13) Orattlesnake (Iine4) 



Ocopperhead (line 7) (18) 
•however (line 18) (54) 



Members cf the committee speculated that a weak grasp of sequence and 
transitional elements in paragraphs (illustrated by Examples L and M) may 
be related to the loss of coherence reported by the National Assessment of 
Educational Progress Project in its most recent study of the writing of 
seventeen-year-olds. Of equrl concern to the committee was the confusion 
displayed by many students when asked to identify the sentence in a paragraph 
containing a verb with an inconsistent tense, as in the following example. 



EKLC 



Written Expression Results, Grade Twelve 



Example N 



WASHINGTON (UPI)-(I) DirectorWilliam E. 
Colby admitted Tuesday the CIA kept a secret 
cache of deadly poisons and forbidden weapons— 
including a suicide drug for captured U.S. spies— 
despite Presidential orders to destroy them in 
1970. 

(2) Later, Dr. Frank Gordon, a retired CIA 
scientist, identifies himself and two colleagues as 
the agency officials who secreted the most 
potent of the banned poisons in a vault where it 
remained hidden for five years. 

(3) Gordor> was questioned for hours by the 
Senate Intelligence Commivtee. (4) He said his 
group decided the White House directive did not 
apply to the CIA supply of deadly shellfish 
toxins because they were chemical, not bio- 
logical, and because he thought the directive was 
meant only for the Army. 

(5) In his testimony, Colby produced a black 
electric dart gun, slightly larger than a.45-cdliber 
pistol, and explained it could fire poison-tipped 
darts 100 yards and kill a person silently and 
mstantly at that range. 

(6) Colby also said the secret cache of poisons 
made from cobra venom and shellfish toxins 
couid be used in offensive weapons such as the 
dart gun or in new, improved suicide pills for 
U.S. spies. 

Which sentence is inconsistent with the time 
development? 



(21) O Sentence 1 
(35) O Sentence 2 



OSentenceS (27) 
OSentence4 (17) 



Members of the committee concluded that the weak performance on this kind of 
task reveals a lack of understanding of time patterns as it relates Zo 
consistency of verb^ tense in paragraph development. 

Related to this difficulty is che one of establishing consistency of persor 
in a sentence or paragraph. In the following test item, over half of the 
twelfth graders failed to detect the inconsistency between a pronoun end its 
referent: 
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Example 0 



In each sentence there may be an error. 
If there is an error, decide which 
underlined part must be changed to make 
the sentence correct. Mark the oval 
corresponding to the letter for the 
underlined part. 



Many of Shakespeare's plays appear to question 

A 

whether it is within the power of man to 
B 

control your own destiny. Mq error 
C 5 — 



OA OB •C OD 

(10) (14) (45) (31) 



The low score on this question may reflect a more batic difficulty, that 
of recognizing the referent of a given pronoun in the first place. In 
this case "man" is the referent of the incorrect "your." Such difficulties 
with pronoun reference were noted by the Reading Assessment Advisory 
Committee in their analysis of the reading results at all gr^de levels. 

Summary of the Committee's Findings and Recommendations 

Members of the committee were pleased to see the slight overall improvement 
shown by twelfth graders in written expression from 1976-77 to 1977-78* They 
are hoping that this year marks the beginning of an upward trend in written 
expression achievement for h±gh school seniors. In their examination of the 
resv .ts, the committee discerned a pattern of strengths and weaknesses which 
is highlighted as follows: 

• Most California high school seniors demonstrated an ability 
to handle some fundamental writing skills tested on the 
Survey of Basic Skills: Grade 12, s uch as the following: 

1. Selecting the correct form of a word in a sentence 
(Example F) 

2. Differentiating between complete and incomplete 
sentences (Example I) 

3. Inserting needed punctuation in sentences 
which the i^tural junctures of spoken Eng sh 

" could be used as a guide (Example D) 

• Too mary twelfth graders are showing unei^ected confusion 
o<er the rudimentary skill of spelling words correctly 
when suffixes are attached (Examples B pnd C). 
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m Twelfth Naders are also less adept at some of the more 
demanding language skills, such as: 

1. Using appropriate punctuation in sentc^ices where 
the student must be guided by knowledge of a 
rule or convention rather than by the sound of 
spoken English (Example E) 

2. Recognizing the most specific or general word 
in a group of words (Exainple H) 

3. Selecting a word which is most likely to 
convey a given attitude or emotion (Example G) 

4. Identifying a particular grammatical element 
in a se ence (Example J) ^ 

5. Recognizing the most effective and concise 
statement of an idea (Example K) 

» The decline in paragraph skills from 1975-76 to 1977-78 is 
of particular concern to the committee since the ability 
to handle these skills is so closely related to coherence. 
Significantly, in its latest report on writing, the National 
Asessment of Educational Progress reported a decline in 
coherence in the writing of seventeen- year-olds throughout 
the nation. 



Guided by an understanding of the difficulties students were having, the 
English Language .issciisment Aavisory Committee offered the following 
recommendations for teaching: 

Spelling. A skill maintenuncc program in spelling for junior and senior 
high school students is needed. Such a program should involve a highly 
structured approach to spelling instruction which would introduce words 
grouped according to spelling generalizations, particularly generalizations 
which apply to the formation of new T^rds by the addition of suffixes to a 
base word. This kind of structure coupled with appropriate practice should 
enable students to learn a number of highly useful generalizations which can 
be applied to many other words. More time and especially more efficient 
and specific instruction snouid be devoted to the spelling needs of junior 
and senior high students. 

Language Choices . Intermediate and secondary students should have more 
experience and more focussed instruction in a number of dimensions which 

effective language choices in writing. These factors; include 
the degree of specificity of a word (see Example H) and the emotional tone 
conveyed by a given word in a particular context • (see Example G) . The 
Reading Assessment Advisory Committee, which found that many twelfth grade 
students displayed confusion on somo of che reading questions requiring 
them to detect the author's emotion or attitude in a selection, concurred 
that students need more focussed instruction in the language choices skill 
area. ^ 
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Para>^raphs , Specific and sequential instruction in a variety of paragraphs 
skills (including stating ideas in a logical sequence, using transitions, and 
achieving consistency of verb tense and pronoun reference) is needed at the 
secondary level. Such instruction in the paragraph skills should be re- 
inforced by the detailed examination and discussion of written material through 
sustained classroom discussions. 

Members of the Reading Assessment Advisory Conmittee concurred with the English 
Language Assessment Advisory Conmittee in feeling that the intensive study of 
paragraphs skills is likely to increase reading comprehension as well as 
improve coherence in student wxiting. 
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Synopsis of Findings 



Tlie following siaaaary is based on an analysis of the mathematics results 
obtained from the spring assessments in 1976, 1977, and 1978. Tta members 
of the California Mathematics Assessment Advisory Conmittee alsc met to 
express their views on the assessment results which are included in the sunnary 



..rade Six Achtev«»in«>Tih TmprmrftQ 

Over a three-year period, the overall mathematics achievement score of 
California's sixth grade public school students has Improved 1.1 points in 
percent correct units. This has resulted in an increase of 2 percentile 
points on a pvbJ.lsher's national norms (Comprehensive Tests of Basic Skills ) 
The percentile rank of the typical California sixth grade student now stands 
at 53 on that publisher's national norms. In 1977-78, the students showed a 
positive imprxrt'enent in all four major content areas— arithmetic, geomc^ry, 
measurement and graphs, and probability and statistics. The conmittee ob- 
served that out of the 15 subskills contained in these content areas the sixth 
grade students showed positive increases in thirteen, a slight decline in one 
and a significant decline in one (number properties). 



Grade Twelve Achievement Sc-ib lllzes 

After a slight decline Ir the period 1975-76 through 1976-77, the mathematics 
achievement score of the twelfth grade students in Cflifomia's public schools 
remained the same in 1977-78 as the score in 1976-77. The peicentlle rank of the 
typical California twelfth grade student remains at 43 on a publisher's national 
norms. When the 1977-78 scores are compared with the 1976-77 scores, che twelfth 
grade students' scores improved slightly in arithmetic and in probability and 
statistics and declined slightly in algebra^ seometry, and measurement. The 
advisory conmittea observed that out of a total of 17 subskills, the twelfth 
grade stu .:ats showed significant Improvement in one (decimal computation), 
a slight ImprOTement in seven, sligh*-. declines in seven, and two remained 
stable. 



Performance of Boys and Girls 

An analysis of the results by sex showed that girls do consistently better 
than boys in computations with wliole numbers, fractions, and decimals. The 
girls also outperformed boys in simple one-8ti5<p word problems. However, the 
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conmlttee found that boys typically scored higher on word problems that were 
either multiple step problems or required more reasoning ability. 

In geometry the girls scored higher than boys ou questions involving recall 
and identification of geometric shapes, while boys achieved higher than girls 
on icemfi dealing wfth spatial relationships and reasoning ability. In 
measurement the sirls generally scored higher than boys on problems dealing 
with money; hovrever, boys generally p.erronned better than girls on the other 
questions. 

At the twelft-h grade the relative jperf omance of boys and girls was compared 
taking int«'> consideration the amount of mathematical preparation of the 
particular courses that students had completed. The conmittee noted thet the 
girls continue to outperform boys at the twelfth grade in whole number and 
decimal computations. However^ the girls do not keep up their relative 
achievement level in fraction computation at the twelfth grade. The conmittee 
observed that girls were considerably Iwo.r in the skill aress of measurement, 
geometry applications, and probability and statistics. 

The ccnmitilee refrained from 3peculating on the causes of these cax differences. 
It was felt that if further more intensive studies confirm these patterns, these 
findings may have some far-reaching implications for the design of instructional 
programs and teaching methods, especially at the elementary school level, 

Recommendations 

The committee offered the following, recotnnendationc for improving mathematics 
achievement across the grade levels. 

Emphasis on problem-solving skills . At grade six the scores on application items 
were generally lower than the comrilttee's expectations v^itn the exception of 
those -fn the area of measurement and graphs. The coonlttee strongly recoronended 
increased development of and corilcular emphasis on problem an^^lysis and problem 
solving at all grade levels. 

Emphasis on understanding basic operations . To enable the students to under- 
stand the reasons why an answer to a problem is correct and to help <»tudent5 
understand why the operation- are done in a certain way, the conmittee 
recommended aa increased emphasis on teaching the concepts underlying basic 
arithmetic operations . 

Ijnphasis on geometric relationships . The cofmittee reconmended an increase 
in the curricular amphasis at all grade levels on basic geom/^trlc relationshlp<i 
as they apply to practical situations. In particular, the opportunity for all 
students to develop and use spatial relationships should be increased, 

Reccmmendatlong, /o r further study . The committ'^e reconmended t^iat the potential 
of matrix samplii:% be mere -fully exploited. For example, a new experimental 
test form should bt l.^troduced each year in order to (I) develop a systematic 
pool of new items tiiat are sensitive to periodic changes in curriculum; and 
(2) to pursue in-depth studies ii*; specific areas, such as exploration of sex 
differences in mathematics achlcvemenr. 
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Scope of the Grade Six Survey 

The Survey of Basic Sklll r - Grade 6 was developed specifically to assess the 
students' attainment of mathemaMcs skills taught through th^ ^i^cth grade 
level in most California schools, I'he 160 questions on the Survey were de- 
signed to assess students* skills in the areas of arithmetic, geometry, 
measurement, and probability and statistics • Figure 10 is an illustration 
of the emphasis pieced on each skill area in the total test. In the figure 
th^ skill area of arithmetic, is subdivided into number concepts, whole num- 
bers, fractioiis, ar»d decimals • The emphasis on each area in the test is 
consistent with the general mjathematics curriculum of most Califomia schools 
and the reccnmenc « tions in Mathematics Framework for California Public Schools . 
A detailed description of the skills assessed in the Survey Is given in Test 
Content Speciticatioiis for t h? Survey of Basic Skills; Mathematics, Grades 
Six and Twelve (Sacramento: California State Department of Education, 1975). 
Additional descriptions of u.!e major skills assessed in the Survey and example 
test questions are i.'::luded in Appendix F of this report. 
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Compariso n of 'l975-76, 1976-77, and 1977-78 Results^ Grade Six 

Table 8 contains a sunmary of the results of the mathematics portion of the 
ri:cth grade sdrvey for the past three years--1975-76 through 1977-78. The 
tejle also shows the changes in scores from 1975-76 to 1976-77 and from 
1976-77 to 1977-/8. A detailed breakdown of skill area results is given in 
Appezidijc F. 

The following overall conclusions are apparent from an examination of the 
data in Table 8. 

• The mathematics overall scores are improving consistently for 
the three-year period. The gains were stronger from spring, 
1977, to spring, 1978, than frcoa spring, 1976, to spring, 
1977. 

registered most gains followed by the skill area of measure- 
ment and graphs. Consistent but smaller gains are also re- 
gistered in the skill areas of whole numbers and probability 
and statistics. 



Table 8 



Average Mathematics Scores and Changes in Scores on the 
Survey of Basic Skills: Grade 6 , 1975-76 through 1977-78 



Skill area 


Number of 
questions 


Average percent 


correct 


Change 


1975-76 


1976-77 


1977-/8 


1975- 76 
to 

1976- 77 


1976- 77 
to 

1977- 78 


MATH, TOTAL 


160 


57.4 


57.7 


58.5 


+0.3 


+0.8 


Arithmetic 


96 


61.0 


61.0 


61.8 


0.0 


+0.8 


Number concepts 


28 


65.4 


65.5 


65.6 


40.1 


+0.1 


Whole numbers 


28 


66.9 


67.5 


68.0 


+0.6 


+0.5 


Fractions 


20 


49.6 


49.0 


50.6 


-0.6 


+1.0 


Decimals 


20 


56.3 


57.8 


59.0 


+1.5 


+1.2 


Geometry 


20 


58.8 


58.5 


59.3 


-0.3 


+0.8 


Meiasurement and 














graphs 


32 


52,1 


53.5 


54.4 


+1.4 


+0.9 


Probability and 














statistics 


12 

1 


40.4 


40.9 


41.6 


+0.5 


+0.7 
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Skill Area Results for Grade Six 

The California Mathematics Assessment Advisory Comnlttee reviewed In depth 
the mathematics results by skill areas, as they have done In previous years. 
Ihe comnlttee members judged th^s adequacy of student performance In llgVt of 
the difficulty of the questions, the relative exposure of each skill in a 
typical classroom, and changes In student performances over a period of 
three years* 

Arithmetic. The arithmetic portion of the Sv irvey consists of a total of 96 
questions In four skill areas— number concepts, whole nunterd, fractions, and 
decimals. There wa-^ an overall Increase of 0.8 percent correct In arithmetic 
from 1976-77 to 1977-78. 

The number concepts questions assess knowlec^gs and skills in the areas of 
numeration, number theory, and number properties. Of the 13 numtration 
questions, the scores increased on nine questions and decreased on three, 
resulting in an overall Increase of 0.1 percent correct froui 1976-77 to 
1977-78. For the nine questions in number theory, the score remained essen- 
tially unchanged; however, of the six number properties quettions, the scores 
declined for five and Increased for one. 

The Mathematics Assessment Advisory Coaanlttee remarked that a continued de- 
cline in the area of number properties will lead to a greater lack of under- 
standing of the baaic mathematical processes as the students proceed through 
the school program in mathematics. Example A is illustrative of the items 
that typically showed a decline. 



Example A 



Select the correct name for themfSiiing number: 
3 X 26 = (3 X □) + (3 X 6) 

(19)0 2 

(12) 0 6 
(37)*20 

(13) 0 26 

(19)o None of these 



Percent Correct 

1975- 76 40.9 

1976- 77 37.8 

1977- 78 36.5 



On the 41 items involving computations with whole numbers , fractious, and 
decimals, the students* scores im.reased on 39 items and decreased on two 
when 1977-78 scores were compared with 1976-77 scores o Over the same period, 
on the 27 items involving application of whole numbers, fractions, and deci- 
mals, the scores inereaeed on 19 items, decreased on six, and remained the 
easm on two. The gains in student scores are ihown in Table 3. 

It was >he Judgment of the advisory conniittee that there was good, consis- 
tent g7 th on most, of the computation items, particularly in comp^itaf ion 
with decimal fractions. The Itemt* on which there was little or no improve- 
ment involved comprehension of a process, rather than a simple knowledge of 
facts. 
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Examples B and C are typical of the problems on which scores consistently 
increased over the three-year period. 



Example B 



64)386 

(6)02 remainder 6 
( 5) O 6 remainder 1 
(80) 9 6 remainder 2 
( 9) O 6 remainder 4 



Percent Correct 

1975- 76 77.0 

1976- 77 78.1 

1977- 78 79.9 



Example C 



Subtract 76.8 from 462.53. 

( 4)0 539.33 
(24)0 <54.85 
( 5)Q 386.73 
?iTy^ 385.73 
(30)0 None of these 



Percent Correct 

1975- 76 25.9 

1976- 77 34.2 
1.977-78 37.3 



Geometry . An overall increase of 0.8 in the average percent correct in the 
major skill area of geometry occurred from 1976-77 to 1977-78. ^'f the twenty 
qu<i:;r: ions in geometry, students increased their average percent correct in 
seven out of eight questione concerning knowledge of facts and five uut of 
12 geometric application questions; the students' scores decreased on six 
questions and remained the same on two. 
/ 

Most of the increase in geometry scores was the result of an improvcmor t in 
the knowledge of geometric facts. The scores in the knowledge of fac:;:s in- 
creased 1.3 percent correct compared with a 0.4 percent correct increase for 
geometric applications. Example D is representative of the test items on 
viiich scores increased. 



Example D 



Which picture shows paraUel lines? 



(77)» 



( 6)0 




Percent Correct 

1975- 76 74.8 

1976- 77 76.8 

1977- 78 77.1 
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( 6) O 



( 7) O None of tliese 



In the judgment of the advisor^/ comnittee, greater .itcention needs to be given 
to geometric applications in general in kindergarten through grada six. In 
particular, students seem to need increased instruction in identifying right 
angles, quadrilaterals, and facts such as the sum of the interior angles of 
a triangle is 180 , 

Measurement and graphs. In the o.erall major skill area of m-asurement and 
graphs, students' scores showed an increase of 0.9 percent correct from 197 f>- 
7^ to 1977-78. In the previous yeer scores in this skill area showed an 
increase of 1.4 percent correct. 

Of the 32 questions in measurement and graphs, the scores increased on ten 
of the 14 questions concerning knowledge of facts and 15 of the IS application 
questions. The scores decreased on four questions and remained the same on 
three quest ioas. 

The members of the comnittee inferred from the results that students do very 
well and are continuing to improve in readJrg ^ad Interpreting bar, circle, 
and simple line graphs. In addition^ students continue to show strength in 
understanding linear m-asurement, mcr.ey vaiuas, and reading scales and other 
measuring devices. On the other hand, test scores indicate that students 
continue tc have difficulty understanding the concepts and computation of 
perimeter, area, and volume. In metric conversion, the comnittee members 
noted an improvement ir. scores; however, they judged that the scores were 
lower than desired. The committe recomnended that some increased emphasis 
be given to this skill Example . is a typical metric convp.rsion problem 



Example E 



L 



metres 40 centimetre . = 



( 3) O .etre5 

(34) O • etres 

(22) O 8a .. letres 

(41) • 2 iO centimetres 



Percent Corre^^t 

1975- 76 32.9 

1976- 77 39.7 

1977- 78 41.2 
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Probability and statistics . The sixth grade purvey Includes 12 items on 
probability and statiotics. Seven of the questions are related to simple 
statistical computation or based on an intuitive approach to probability. 
Hie other five questions require the students to apply concepts in probability 
and statistics to solve problems. 

In the skill area of probability aiid statistics, the average percent correct 
score increased 0.7 percent correct from 19 76-77 1^^77-78. The previous 
year's scores in this skill area showed a similar increase. From 1975-76 
through 1977-78 the percent correct scores increased by 1.2. Overall, 
students' average percent correct scores increased on nine questions and 
decreased on thre<2 from 1976--77 to 1977--78. 

Although the scores ou these questions generally improved, the coramitt^sc judged 
the scores lower than their expectations. The lowe^st scores i found to be 
on problems involving simple terminology, such as "average" and "mean.*' Since 
probability and statistics terms are used so frequently in everyday life (for 
example, "chances of rain," "batting averages," and "median salary"), students 
should be able to understand and use them. Example F is a typical item using 
conmoi statistical terminology. 



Example F 



On a mathematics test students obtained thu 
following scores: 

68. 75. 80. 86. 95. 100 

V.ndt is the range o\ these scores'* 

(13) ♦ 32 

( 6) O 42 ' 

(18) O. 68 

(26) OlOO 

(37) O None of these 



Percent Correct 

1975- 76 17.2 

1976- 77 13.7 

1977- 78 12 9 



In the judgment of the conmittee, the test resulte indicate that students 
are leaning some simple concepts of probability and i ..atistics> However, 
more emphasis in classroom instruction needs to be giv^n to thf application 
of these coonon concepts and skills since these scores arn lower than those 
on any other section of fhe >T\athematics test. 
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Scope of the Grade Twelve Survey 

The Survey of Basic Skills: Grade 12 was developed to assess the degree tc 
which students have acquired %asic" mathematics skills by the end of the 
the twelfth grade. A statewide committee coiiipiled objectives and revi ved 
questions for inclusion in the test. The 198 questions on the Survey were 
der^snied to assess students' skills in the areas of arithmetic, algebra, 
geometry, measurement and graphs, and probability and statistics. Fig-^re 11 
is an illustration of the emphasis given to each oikill area in the jtal 
test. In the figure the skill area of arithmetic is subdivided into the areas 
of number concepts, whole numbers, fractions, and decimals. A complete 
description of the skills assessed in the Survey is given in Test Content 
Specifications for the Survey of Basic Skills; Mathematics, Grades Six and 
Twelve (Sacramento: California State Department of Education, 1975). Addi- 
tional descriptions of the major skills assessed in the Survey and example 
test questions are Included in Appendix G of this report. 




Fig. 1 1 < area emphases in the .iurvey of B^ic Skilh: Gmd^ 12 



32 



Student Achievement in California Schools 



Mathematics Results for Grade Twelve 

Table 9 shows the mathematics achievement results of California twel"^ 
grade students on the total test and in the skill areas ^or three years, 
troii 1975-76 through 1977-78. A detailed breakdown of ^1 area results is 
given in Appendix G. 

Table 9 



Average Mathematics Scores and Changes in Scores on the 
S urvey of Basic Skills: Grade 12 , 1975-76 through 1977-78 



Skill area 


Numb e r of 
ques t ions 


Average 


percent 


correct 


CTiai 




1975-76 


1976-77 


1977-78 


1975- 76 
to 

1976- 77 


1976- 77 
to 

1977- 78 


TOTAL MATH 


198 


67 


0 


66 


3 


66 


.3 


-0.7 


-0- 


Arithmetic 


98 


72 


9 


72 


1 


72 


.2 


-0.8 


+0.1 


Number concepts 


28 


74 


3 


73, 


5 


73 


6 


-0.8 


-M).l 


Whole numbers 


22 


80 


1 


80, 


1 


80 


1 


-0- 


-0- 


Fractions 


26 


66 


0 


64 


5 


64 


3 


-1.5 


-0.2 


Decimals 


22 


71 


8 


71. 


2 


72 


0 


-0.6 


+0.8 


Algei; L a 


32 


62, 


9 


62. 


1 


61 


8 


-0.8 


-0.3 


Geometry 


?A 


62. 


7 


62. 


1 


61. 


8 


-0.6 


-0.3 


Measurement 


30 


60. 


5 


59. 


5 


59, 


4 


-1.0 


-0.1 


Probability and 




















statistics 




57. 


2 


56. 


9 


57. 


3 


-0.3 


+0.4 



An exaT-- ^t:ion of the data in Ta>^le 9 shows the following trends: 

I cverall mathematics achievement of Cali. rnia twelfth grade 
jents remained constant from 1976-7/ tc 1:^^77-78 afcer z 
cline from 1975-76 to 1976 77. 

« rrcm 1975-76 to 1976-77 the declin? i' achievement occuric.d ?.n 
all skill areas except in the area of whole n -hers. The 
greatest -jecli'ie was in the area of fractions. Froai 1976-77 to 
1977-73 th^ decline continued in the skill areas of fractiois, 
alge'^ ra, g'" etv}', and measurement. However, the skill area^ or 
-iec' .ials :.n ^ "^-.^babilit .nd statistics registered a gain. 
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Skill Area Results for Grade TvelVi^ 

The following discussion is based on ^ review of the mathematics results by 
the California Mathematics Assessment Advisory Committee. The committee 
members judged the adequacy of student performance in light of the difficulty 
of the questions, the relative exposure of each skill to a typical student, 
and the changes in student performances over a period of three years. 

Arithmetic . The arithmetic portion of the test consists of 98 questions in 
four skill areas: number concepts, y7hole numb^ro, fractions, and decimals. 
In Table 9 the arithmetic percent correct score lor the three years is shown 
as 72.9, 72.1, and 72.2. 

The 28 questions in the number concepts skill area Include problems in 
numeration, number theor>', and number properries. From 1976-77 to 1977-78 
the students* scores showed increases on 15 questions, decreases on ten, and 
no change on three. The scores of students declined consistently over the 
three-year period on questions dealing with rounding of numbers, recognizing 
the place v^lue of a digit, and recognizing odd and even numbers. The fol- 
lowing te item is an example in which the score declined by approximately 
7 percent c -rect during the three-year period. Approximately 27 percent of 
the student were not able to distinguish between tenths and tens. 



iHxample A 



In which numeral is the digit 7 in the tenths' 
place? 



O 976.3 O 97.63 

(27) (U) 



9.763 O 0.9763 

(50) ( 9) 



Percent Correct 

1975- 76 57.1 

1976- 77 52.2 

1977- 78 49.7 



The Survey contains a total of 42 questions involving computation with whole 
numbers , fractions , and decimals . In whole number computation the scores 
increased on six questions, decreased on seven, and remained unchanged on one 
from 1976-77 to 1977-78. During the same period the scores in fractions 
increased on nine questions and decreased on ff,ve. In decimal computation 
the scores increase : on all the 14 questions except one in which the score 
was unchanged. The percent correct score increased by 1,0 from 1976-77 to 
1977-78 in dec: oal computation. Whole number computation and fraction compu- 
tation scores increased by 0-2 and 0.1 percent correct respectively. Example 
B is an illustration of the type of test item on which the scores shov/ed a 
continued increase. 



Example B 



2.759 
X 806 

( 5) O 233,274 
( 5) 02.173754 



02,174,754 ( 4) 
• 2,223,754 (86) 



Percent Correct 
1975-76 84.1 
1976 77 85.7 
1977-78 86.4 
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On the 28 items involving applications of wdole numbers, Fractions, and 
decimals, the aver?.ge score increased 0.6 percent correct in decimals and 
decreased 0.3 and 0.5 percent correct in whole numbers and fractions respec- 
tively from 1976-77 to 1977-78. The students' scores increased on all of the 
eight items in decimals. In whole numbers .he scores decreased in six of 
the eight items; on the 12 items involving fractions, the scores increased on 
four, decreased on seven, and remained unchanged on one from 1976-77 to 1977-78. 

Examples C and D are illustrations of the type (. Questions on which the scores 
generally declined from 1975-76 to 1977-78. These questions, and most others 
like them on vhich a consistent decline occur jd ^ involved division. 



Example C 



Example D 



There are 36 boys in our club. If we place them 


Percent 


Correct 


or- 4 teams, bow many will there be an each 






team? 


1975-76 


:5.i 


( 2) 06 ( 2)0 12 ( no36 ( 1)0 40 


1976-77 


94.4 


(94) ♦None of these 








1977-78 


94.0 








f 

A bar of carK-^y was divided among three people 


Percent 


Correct 


so that Mildred had ^ of the bar and Abby had 






^ What fraction of the bar was left for Georgs? 


1975-76 


80.6 


• e' oi o| 


1976-77 


78.2 


(77) ( 2) (lA) ( 7) 
■ ■ 


1 ■'7-78 


76.9 



The advisory conmittee was quite pleased with the average percent correct 
scores in computatioii with whole numbers (81.2) and in computation with 
decimals (74.3). They anticipated that improvement in these two skills \n 
future years would probably be small. The committee felt that the coverage 
percent correct in computation with fractions (68.4) should be improved. 
The committee aL^o felt that the average percent correct in applications of 
decimals (67.2) and applications of fractions (59.5) should be improved. 



Algebra. In the major skill ar- a of algebra, the scores declined 0.3 percent 
correct from 1976-77 to 1977-78. This decl ine fol lowed the previous year's 
dp' line of 0.8 percent correct. Of thu 14 algebraic computation items, the 

cores declined on ten and increased on foui from 1976'"77 to 1977-78. Of 
the 18 algebraic applications questions, which also included questions on 
the interpretation of Lables, charts, and graphs, the scorei: declined on 12 
quo i: ions, increased on four, and .ema.ined unchanged on two. 

Examples E and F are illustrations of the types of test items on which the 
scores generally declined. 
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Example E 



It X = 3i and y • 3/, then y 



09x 
(12) 



(D3X 
(13) 



9 X 

(70) 



of 

( 5) 



Example I 



If I = 6, then* = 



• 18 

(77) 



O 6 

( 2) 



02 
(19) 



( 2) 



Percent Corrt-ct: 



1975- 76 

1976- 77 
IV 7-78 



71.9 
70.9 
69.9 



PercentCorrect 



1975- 76 

1976- 77 

1977- 78 



80.6 
77.4 
76.5 



Geometry. Th». geometry oortlon of the Survey consists of 24 questions. Half 
of the questions require the students to identify basic geometric sets and 
figures, and remaining half require them to apply basic geometric knowledge 
and concepts. As shown in Table 9, the overall average percent correct in 
1977-78 was 61.8, a decline of 0.3 percent cor-ect rom the score in 1976-77. 
The overall geometry score qlso declined the previf s year by 0.6 percent 
correct. 



Of the 12 questions requiring students to identify geometric figtii.<.-, the 
scores increased on five questions, decreaiied on six, and remained the -iame 
Oil one whan 1977-78 scores were compared with those of 1976-77. They'd ch.anges 
reflected no overall change in the vledge of geometric facts from 1976-77 
to 1977-78. In the previous y ar nowledge of geometric facts iiicreane-d 

0.3 percent correct. 

Of the 12 questions on geomecric applications, the scores increased on five 
and ieci^ZBf'd on s^ven questions when 1977-78 scores were conq)ared with those 
of 1976-77, ri:e8e changes amounted to in overall decrease of 0.6 percent 
correct fron, 1976-77 to 1977-78. In the previous year the score ia geometric 
application" decreased by 1.4 percent correct. Thus, it is apparent that the 
overall geo..;try score declined because of the declining performance on 
geometric application questions. Exair"le G is an illustration of the type 
of question on which the scores declined continuously over the period from 
1975-V6 through 1977-78. 



Percent Correct 

1975- 76 36,5 

1976- 77 33.8 



1977-78 32.5 



In the figure above, the lines AE and CD are 
perpendicular to AC. What is the distance 
from A to E? 

(27) (33) (17) ( 4) 

04Cft. •52 ft. O60ft. 0 6[)ft. 

ONone of these 

(19) 

93 



Example C 
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The average test item involving a recall of geometric facts was answered cor- 
rectly by 75.5 percent of the twelfth grade students, and that percant re- 
mained consistent over the period from 1975-76 through 1977-78. It was 
the judgment of the advisory conmittec that studcrnt performance is nearl 
satisfactory with respect to the recall of geometric facts. An overall . 
crease of 2,0 in the average percent corre^^ on application questions during 
the period from 1975-76 through 1977-78 was viewed with concern by the 
advisory committee. The conmittee judged that the average percent correct 
of 48,1 in geometric applications was too low. 

In the judgment of the advisory conmit ^e, an increased curricular emphasis 
is needed in high school on applications of geometric relationships. In 
particular, the conmittee reconmended an emphasis on problems involving 
similar triangles, the Pythagorean theorem, the sura of the angles of i tri- 
angle, and the identification of right angles and perpendicular lines. 

;easurement . The 30 questions in the major skill area of measurement consist 
of \?. questions on recall or computation and 18 questions on applications. The 
overall percent correct in 1977-78 for the skill area of measuremuent was 59.4, 
which was 0.1 percent correct lotjer than the 1976-77 score. The measurement 
score declined 1.0 percent correct from 1975-76 to 1976-77. 

Or the 12 recall or computation questions in measurement, tae scores declined 
on eight Questions, increased on three,, and remained the same on one from 
1976-77 to 1977-78. These changes resulted in an over.-^ll decrease of 0.4 
percent correct on the recall or computation questions. From 1975-76 to 
1976-77 the overall score declined by 1,1 percent correct on the same questions. 

the 18 questions on measurement applications, the scores increased on S3ven 
questions, decreased on nine, and remained unchanged on two when 1977-78 scores 
were compared with those of 1976-77. These specific changes resulted in no 
change in the overall score in measurement applicat ' ns from 1976-77 to 1977-^78, 
In the previous year the score in this skill area decx"e sed by 0.9 percent cor- 
rect. Example H is typical of the test i* ans on which the scores declined from 
1975-76 through 1977-78, 



Example \\ 



A housewife wiil pay the lowest price per 
ounce for rice if she buys: 



(11) O 12 ounces for 40 cents 

( 9> O 14 ounces for 4f. cents 

(36 9 1 pound, 12 ounce*^ )r 85 cents 

) o 2 pounds for 99 cent? 



Percent Correct 

1975- 76 40,5 

1976- 77 36.8 

1977- 78 36.2 



The advisory conmittee judged that twelfth grade students have a basic under- 
standing of metric units and ability to convert from one metric unit to an 
equivalent metric expression. Students al?3o did very well in ci!>nverting from 
miles per ho^jr to miles per minute. Example I is typical of the questions 
asked in the metrics section and of the scores achieved. 
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Example. I 



One metre is equal to 10 decimetres How 
many metres ire equal to 80 decimetres 



O800 

( 9) 



• 8 

(85) 



O 0.80 O U.08 
(5) (1) 



Pi^rcent Correct 

1975- 76 82./ 

1976- 77 84.1 



1977-78 



84.5 



ITie comnlttee noted that scores of students wpre Inu ^ 

Itlttlr- U.^^, ^ -ograM. t.,e advisory corndttee reconi«nded that 

involving the use of fonnulaTfor computing pe;i^ters lll^l^T^ 

geometric figures. F^i-i-ng perxaeters, voltnnes, and area:, of 



at 

f.. 1977-78 .as 57.3. --^ich^was a oT4-p;;;enrc;;;;:ri;;r;:::e ^^r^t^e'prl! 



The six questions in this skill area require students to compute th^ prob- 
abJlity of simple events and such statistics as the mean. SI and the 
meoian of a set of numbers. From 1976-77 to 1^77-78 the scorer ori'an .^ 
questions increased by 0.7 percent correct overall, ^n the n'ev'us ve h. 
score In this skill area decreased by 0.3 percent correct 

^crP^fn^^' questions on applications, the scores increased on five questions 
decreased on one. and remained the same on tvo. Tl,ese changes resulted Jn k?' 
overall increase of 0.2 percent correct from 1976-77 to 19^!?8 ExI^l! t 
is an illustration of an application „„.«t<.n ^'"^^'^ 
formance on the item. ' " «Luueni. per- 



t, :Aplt J 



A bowl contains 8 identical marbles, except for 
color. One is a white marble, 3 are red marbles 
and 4 are blue marbles. !f you were blind- 
folded and then removed one marble from the 
bcwl, what is the probability th.^t the marble 
you removed would be red? 



( ^) OO (12)0^ (67)< 
O None of these 



8 



( 7)0 i 



Percent C ori-ppf 

1975- 76 65.3 

1976- 77 65.9 
1977^78 66.5 



The advisory conmittee Judged that most students have learned the computatior 
of averages (means) but are not familiar with the importan:-. concept of oedJan 
Example K is a typical test iteu iuvolving the computation of a median. 
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Example K 



r, 



Fiird (he median of the roiiowing set of nun- 
bers. 68, 92, 84, 72, 8 . 75. 78 

0 8^- O 80 O 79 <» 78 C 75 

(23) (18 » (32^, (17) (10 ) 



r^ercent Co rrec t 

1975-76 14. 1 
1^76-"' ^ 16. u 
1977-78 17. = 



The couL-ni ' J. ee felt Lhat .since the basic j/robability ond s tat i.s t lea 1 c \'i 



an! ^eyr-xLVt logy are ( 
should be cesigned t*: 



.ia>' 1 1 f 'ii , the clasnrocni: inst 
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Mathematics Results for Girls and Boys 



llie California Mathematics Assessment Advisory Committee evaluated the 
relative performance of boys and girls in the various skill areas of 
mathematics. At the sixth grade level, data were available on the state- 
wide performance of boys and girls on 160 items; and at the twelfth grade 
level, on 198 items. At the twelfth grade level, the data for boys and 
girls were also available for the number and kinds of math courses taken. 



Achievement Differences at Grade Six 

The committee did not expect to find, nor did they find, large overall dif- 
ferences between the mathematics performance of sixth grade girls and boys in as 
naich as boys and girls share a common mathematics background in kindergarten 
through grade six. Furthermore, the test items were written to favor neither 
boys nor girls. For example, in the writing of the Survey items, an effort 
was made to use names of girls and boys with equal frequency in word 
nrobleias. Care was also taken to present the problems in contexts that are 
familiar to both girls and boys. 

The comittee did identify some very interesting patterns, however, among those 
test questions where girls surpassed boys or where boys surpassed girls. The 
performance of boys and girls by skill area is summarized in Table 10. It 
can be seen that the overall percent correct is only slightly higher for boys 
and the total number of questions favoring either the girls or boys jLs nearly 
identical; but it also shows that in some akill areas the boys' performance 
strongly exceeded the girls' axid in others the opposite is true (although r.ot 
presented here, the patterns were completely confirmed in an analysis of the" 
data for 1976-77). The following sections elaborate on these patterns. 

Girls outperform boys in computation with whole numbers, fractions^ and 
decimals. In the content areas of computation with whole numbers, fractions, 
and decimals, the girls outperformed boys by a conKideiable margin. For 
example, the girls scored higher than boys on all of the 16 questions in whole 
numbers, 11 out of 13 questions in fractions, and eight of the 12 decimal 
computation questions. Table 10 shows the percent correct scores for boys 
and girls on questions in these three skill areas. Examples A and B are 
illustrations of the performances of boys and girls on typical computation tegt 
items. 
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Example A 



9333 
8989 



O 1,344 
O 444 
O 344 
O 244 
O None of these 



Percent Co r re^^t 

Boys Girl 



1976- 77 

1977- 78 



73.3 
74.9 



78.3 
78.8 



Example B 




Percent Correct 

Boys Girl 

1976- 77 48.7 52.8 

1977- 78 50.4 54.6 



The girls also did better than boys on five of the six number properties 
questions. These questions were designed to assess the students' knowledge 
of commutative and associative properties; however, these questions can also 
be solved algebraically. 

Boys do better than girls in applications . In the content areas of applica- 
tions of whole numbers and fractions, boys obtained higher scores than girls. 
Eowever, on decimal application problems the girls performed better than boys. 
A closer look at the individual questions in decimal applications showed that 
while girls did better on problems that required a simple computation or only a 
one-step analysis, boys did better on problems that required more complex 
logical reasoning. Often these problems required an intermediate computation 
(two-step applications problem). This pattern seemed to be borne out in the 
area of applications of whole number and decimals. The two whole number 
applications problems on which girls did better than boys were simple one- 
step problems. The four decimal applications problems on which girls did 
better than boys were one-step computation problems involving money. On the 
decimal problems that demanded more reasoning ability or multiple-step 
computations, the boys outscored the girls. 

It is particularly interesting to note that the relative performance of boys 
and girls did not seem to be related to the context of the problems. 
Example C is an illustration of this point. 
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Table 10 



Mathematics Achievement cf Sixth Grade Boys and Girls by Skill Area 



Skill area 


Description of skill 


Number of 


Number o 
on 


f questions 
which : 


Peicent 


correct 




questions 


Boys scored 
hiKher 


Girls scored 
hiRher 


Boys 


Girls 


Numeration 


Names of numbers, place value, points on a 
number 1 ine 


13 


6 


7 


76. 8 


75.8 


Number theory 


Odd, even, prime, and composite numbers; 
LCM, GCF 


9 


4 


5 


55.7 


56.3 


Number 

properties 


Commutative, associative* and distributive 
propert ies 


6 


1 


5 


55.8 


57.5 


Whole number 
computation 


Addition, s'jbtraction, multiplication, and 
division of whole numbers 


16 


0 


16 


77.0 


80.6 


Whole number 
applications 


Word problems in whole numbers involving one- 
step, two-step, ratio, rounding, or 
algebraic equation 


12 


10 


2 


55.1 


52.3 


Fract ion 

computation 


Addition, subtraction, multiplicatior, and 
division of fractions 


13 


2 


11 


50.7 


53.3 


Fraction 

appl icat ions 


Word problems involving operations on proper 
fractions and mixed fractions 


7 


6 


1 


49.4 


46.3 


Decimal 

computation 


Addition, subtraction, mulf'.plicat ion, n*- 
division of fractions 


12* 


3 


8 


59.9 


61.3 


Decimal I 

app 1 icat ions 


Word problems involving one step and money 
Word probl ems--two steps or complex 


4 

4* 


2 


4 
0 


57.9 
54.8 


62.4 
' 52.2 


Geometry-- 
knowledge of 
facts 


Recognize square, quadrilateral, rectangle, 
angle, parallel lines, cylinder, pyramid, 
and dia-neter 


8 


2 




69.9 


69.5 


Geo-n^try-- 
concepts 


Concepts involving symmet ry , congruency , 
'similarity, locusj angle relationships 
in a triangle 


12 


7 


5 


52.7 


51.9 


Measuremenjf-- 
knowledgd. of 
facts 


Conversion of length, mass, area, and time 
from one unit to another unit; perform 
operations on denominate numbers N,,^^^^^^^^ 


14 


11 


3 


49.4 


46.5 


Measurement-- 
applicat ions 


Calculation of area and volume; reading line, 
bar, and circle graphs 


18 


12 


6 


60.7 


58.2 


Probability and 
statistics 


Compute probability of simple eveucs, 
calculate mean, mode, median and range 


12* 


10 


1 


42.6 


40.5 


Total 


160* 


76 


80 


58.7 


58.3 



* The scores for boys and girls were tied on one or more questions. 
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Example C 



Mother needs 2 cups of sugar for 3 dozen 
cookies. How many cups of sugar will she 
need for 12 dozen cookies^' 

O 5 
O 6 
O 8 
0 17 

O None of these 



Percent Correct 

Boys Girls 

1976- 77 50.5 43.5 

1977- 78 50.8 43.3 



The problem in Example C is a good illustration of a question involving two 
operations. (The problem is usually solved by noting that in 12 dozen 
cookies there are 4 batches of 3 dozen. Thus 4 times 2 — or 8 — cups of sugar 
are needed). The committee suggested that the contexts and settings of 
mathematics problems probably bear a weak relationship to differential 
achiwcment of boys and girls, that is, in comparison to the effects of 
other variables, known and unknown. 

Difference in performance of geometry questions . la geometry girls scored 
higher than boys on six of the eight items involving vocabulary recall and 
identification ^f geometric figures. JOn the two recall questions on which 
boys scored higher than girls, the difference was very large, resulting in 
the overall percent correct for geometry reci>ll questions in favor oi the 
boys. On the 12 concept questions boys scored higher on seven and the 
girls scored higher on five. In examining the seven questions on which boys 
performed higher than girls, it seemed that many of them were related to 
spatial relationships. Example D is one of such problems. 



Example D 



If two different lines intersect, their intersec- 
tion is: 

O a line segment 
O a line 
O a point 
O a triangle 
O a square 



Percent Correct 

Boys Girls 

1976- 77 37.5 33.2 

1977- 78 37.0 31.9 



Differences in performance on measurement and graph questions . On the 32 
questions in the skill area of measurement and graphs , bpys outscored girls 
on 23 questions; girls outscored boys on nine questions. Typically, the 
boys did better than girls on ouch skills as adding, subtracting, multiplying, 
or dividing denominate* numbers » using a ruler measure, converting from one 
unit of measuremi6nt to another, and reading line and bar graphs. The girls 
generally did better than boys on circle graphs and simpler bar graphs. 

' . r 

* A number that designated a quantity as a multiple of a unit. For example, 
in "12 pounds," 12 is a denominate nimiber. 
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Example E is an illustrauion of the phenomenon that if the task was relatively 
straight-forward, the gxrls performed better; but if additional skills were 
required, the boys surpassed the girls. 



Exsraple E 



Bill 
H«nrv 
Tom 
P«t*f 



ID 



I 



1 



J- 



-1, 



J I 



10 20 30 40 50 60 
Waight tr Poundt 

Which boy weighs the 'nost? 

O Bill 
O Henry 
O Tom 
O Peler 

Which boy weighs closest to 50 pounds? 

O Biii 
O Henry 
O Tom 
O Peter 



Percent Correct 

Boys Girls 

1976- 77 96.7 97.5 

1977- 73 96.6 97.7 

Percent Correct 

^oys Girls 

1976- 77 79.9 72.6 

1977- 78 79.7 74.7 



Differences in pe rformance on probability and statistics questions . Of the 
12 questions in this area, six were computation questions and the remaining 
six were word problems. All 'zhe coisputation^ questions required reading - 
of some simple directions. Overall, boys scored higher than girls \)n ten 
questions, scored lower on one, and the same on one. Example F is an 
illustration of the amount of difference between the performance of boys and 
girls on a t^^ical question in this area. 



Example F 



On a math test 

Alice scored 25, 
Betty scored 45, 
Cindy scored 20, 
Dotty scored 30. 

Who scored closest to the average of these 
scores? 

O Alice 
O Betty . 
O Cindy 
O Dotty 



7—783 '2 



Percent Correct 



Boys Girls 



1976- 77 

1977- 78 



35.8 
35.8 



33-0 
34.5 
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Achievement Differences at Grade Twelve 



The analysis cf th'i twelfth grade math results for boys and girls took into 
consideration the mat' hematical backgrounds of the cstudents. In the student 
information section (f the test booklet, each student was required to provide 
information indicating whether he or she took general math, first and second 
year algebra, and geometry courses. The students also indicated the grade in 
which they took a particular course. 

Number of students according to math preparations . Table 11 contains a summary 
of the percents of twelfth grade boys and girls according to their preparation in 
mathematics courses. In the table only those course combinations in which the 
tctal number of stud-mts Was one percent or more are shown. 

At the twelfth grade level, the California Mathematics Assessment Advisory 
Committee expected mo"-e boys to take advanced college preparatory mathematics 
courses than girls. Tliis expectation was met as can be seen in the percent 
breakdowns in Table 11. For example, 24.0 percent of the boys took general 
math, algebra I and II, and geometry as compared to 17.7 percent of the girls. 
However, the overall disparity in percentages was not as great as the committee 
had expected. For example, 51.9 percent of the boys took two or more college 
preparatory mathematic courses (algebra I or II, and geometry) as compared to 
46,7:percent of the girls. Since the University of California system requires 
at least two years of college preparatory mathematics, the committee a^so 
)bserved that approximately 49.3 percent of California's twelfth grade students 
met the math requirements for admission to the university system. 

M athematics achievement ^' ated to preparation . Table 11 also contains the 
avfciTage percent correct ^^ores of students according to their preparation in 
nathematics. As the committee expected, a direct relationship between the 
scores and the xiumber and degree of sophistication of the mathematics courses 
taken is shown by the data. From Table 11 it is also evident that the highest 
scoring group was the one that took only the three college preparatory course.'' 
(first and second year algebra and geometry), constituting 6.5 percent of the 
twelfth grade population. The score of this group was higher tha.n that of the 
group that took general math and the three college preparatory courses. The 
lowest scoring group was the one that took general math only. It is, of course, 
not possible to determine how much of these differences are a result of the 
greater exposure to m.ath concepts and skills, and how much they are a function 
of the general selection phenomena related to a variety of personal, school- 
related, f amily-relate.d, and cultural factors. 

Figure 12 depicts the skill area achievement of four groups of students, accord- 
ing to their math course background. The four course combination groups 
comprise approximately 83 percent of California twelfth grade students. It 
can be seen that the differences between the four groups are nearly linear for 
most of the skill areas. The scores for some skill areas are much higher than 
for others. For example, in the. more elementary, foundational skills areas 
such as whole number computation and applications the results are uniformly 
high. One can also see that while the differences between groups is relatively 
uniform for the skill areas ^;here are some lines that are much steeper, such 
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Table 11 



Percent of Twelfth Grade Students and Their Percent Correct Scores 

by Mathematics Courses Taken 





Percentage of 


students 


Percent 


correct 


score 


' — — T.^ ^W»JH.Jt. 




Boys 


Girls 


Total 


Boys 


Girls 


Total 


General Math only 




23.1 


25.5 


24.3 


51.6 


48.6 


50.0 


Algebra I only 




2.4 


2.3 


2.3 


62.2 


59.5 


60.9 


General Mf*':h + Algebra 
Algebra I + Geometry 


I 


20.0 


23.4 


21.8 


62.1 


59.0 


60.4 




2.2 


2.5 


2.3 


74.2 


72.2 


73.1 


General Math + Algebra 


I + Geometry 


15.6 


17.4 


16.5 


72.9 


70.6 


71.7 


General /^th + Algebra 


I + Algebra II 


3.0 


3.3 


3.2 


66.2 


61.6 


63.8 


Algebra I + Geometry + 


Algebra II 


7.x 


5.8 


6.5 


88.1 


84.4 


86.4 


General Math + Algebra 
Algebra II 


I + Geometry + 


24.0 


17.7 


20.8 


83.8 


80.6 


82.4 


TOTALS 




100.0* 


100.0* 


iro.o* 


68.6 


63.9 


66.3 



* Includes 2.6 percent boys, 2.1 percent girls, and 2.3 percent of the total who 
completed other course combinations. 



i03 



90 



S0\ 



70 p 

i 



60 



50 



40 



30 




Whole number computations 



Whole number applications 
Number concepts 
Geometry-knowledge of facts 

Fractions computations 
Decimal computations 
Algebra computations 
Measurement -knowledge of facts 



Decimal applications 



Fractions applications 
Algebra applications 



I^obability and statistics 



Geometry applications 
Measurement applications 



General math 
onlv 



General Math and 
Algebra I 



General Math and 
Algebra I and 
Geometry 



\ 

General Math and 
Algebra I and 
Geometry and 
Algebra 11 



Fig. 12. Mathematics performance of twelfth grade students by skill 
area and course combination group 
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as that fcr algebra computations. One can speculate that this steeper 
gradient is a funrfion of the impact of additional math instrtiction. In 
some cases, such the lines for geometry applications and geometry knowledge 
of facts, the inflections in the line seem to be clearly related to the 
impact of specific courses. 

Mathemat ics skill area achievement of boys and girls . Figures 13 through 16 
depict the performance of boys and i,irls in each of the 14 skill areas 
according to the math course combinations they chose by the end of the twelfth 
grade. Figure 13 is a representation of the results for those who elected 
general math only, and Figure 16 is a representation of the results of those who 
elected general math, first and second year algebra, and geometry. 

A comparison of the scores of boys and girls within the course cotabinaticn 
groups reveals some patterns of relative strengths and weaknesses similar to 
those of sixth grade students. For example, girls continue to outperform 
boys in whole number computation. In decimal computation the scores of girls 
were higher than those of boys for all the course combination groups exce-pt 
the group that took all four math courses, in whxch the scores were very 
nearly the same. At the sixth grade level, girls performed better than 
boys in fraction computation; but at the twelfth grade level girls typically 
performed slightly lower than boys. 

Comparing the relative performance of boys and girls in Figures 13 tnrough 

16, the committee remarked that for all course combinations girls are relatively 

weaker in their knowledge of facts concerning measurement. For example, 

girls do not dc as well as boys iu such skills as converting f?:om one unit 

of n^easure to another unit(within the same system) and in operations on 

denominate numbers. The relative performance of girls is also lower in th3 

skills of measurement applications, geometry applications, and probabilitv 

and statistics. 



75 r 



70 



60 r 



0 \ 



50 



40 



30- 



25 



Boys 



Gifts 



^^^^"^ ^- Whole niiiTibiir con-.pulati'.ms 



' -^-DeLiinjUoinputalion^ 
- Whole niiinhcr'ipp!ica:ioi)s 
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*"Dccifnal application 

^ iTaciionscomputatioiis 
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•^Algebra applications 



Probability and siatisticr, 
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ttrls 

„ — ^ V.)olc numbiir co:ripula(ioiu 
• V/l:olc niimbcf applications 

-"'-Dccimalcofnputations 

^Number concepts 

*- Geometry -kncwiedfe of facl^ 



^» Measurement-i^nowlcdge of facts 
^Iractioiisiompiilations 



^Dccima! applicalicns 
— AJgebra computations 



*- Algebra applications 

''-iTad'ons applications 
Probabiiily and staiistios 



Measuremcnl applications 



X 



X 



♦"Geometry applications 



Fig. 1 3. Mathematics performance of twelfth grade boys and giris 
who completed general math only 



Fig. 14. Mathematics perfomiance of twelfth grade boys am 
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. (iiris 




Boys 



70 r 



♦-Whole number conipuiiiliujis 



^ Whole number applications 
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Number concepts 
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0 ^ I factions computations 

Measurement -knowledge of facts 
^ ''^Algebra computations 




*- Decimal applications 



I'factions applications 



*- Algebra applications 
^ Probability and statistics 



V ■ H3 Geometry applications 



Measurement applications 



90 



70 



60 




♦-Whole number applications 
Number concepts 

^Fractions computations 
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Fig. 1 5. Mathematics performance of twelfth grade boys and girls who 
completed general math, first-year algebra, and geometry 



Fig, 16; Mathematics performance of twelfth grade 
who complete general math, first^ 
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VI. Analyses of Achievement ^^''oups of Pupils 



In this section of the report, the statewia^ . . v^ement findings are 
averaged across all schools according to different student characteristics, 
such as sex, English language fluency, mobility level, and socioeconomic 
level. However, for sixth grade students only sex and English language 
fluency data are available; for twelfth grade students only sex data 
available. For simplicity, the results are presented sequentially, by 
grade level. 



Some Important Cautions 

This chapter contains the relative achievement levels and amount of change 
over a three-year period for the various types of pupils. The f indings . 
must be read with extreme care to avoid ^conclusions that appear sound on 
the surface but can be shown to be misleading additional information 

is added to the analysis. 

First of all, the reader should not attempt to view student characteristics 
out of context. For "instance, in looking at the mobility table, one might 
conclude that this is a very important factor; however, what makes mobility 
a relevant variable is ite relatioiiship to socioeconomic level, which pro- 
duces the major differences among students' scores and is directly related 
to the mobility level of the students. Higher socioeconomic level pupils 
are less mobile and have higher test scores. A second trap the reader should 
avoid is that of comparing scores across grades or levels of a given student 
characteristic. These types of comparisons assume consistent background 
factors, comparable students, and equivalent group variances. Thus, in 
this report only students within a characteristic level and grade will be 
compared. 



A Pupil Level Analysis of Achievement and Backgro.und Factors 

Grades Two and Three 

As part of the administration of the Reading Test^ teachers provided background 
information about each pupil. When used with the test results, these data 
make it possible to compare the performances of groups of pupils with differ- 
ent background characteristics. This section contains an analysis of the 
effect on pupU performance of four significant background factors: 
(1) the sex of the. pupils; (2) the pupil's English language fluency and 
possible second language spoken; (3) the socioeconomic level of the pupil's 



Pupil Subgroup Analysis, Grades Two and Three 

family as determineid 'by the occupational status of the breadwinner in the 
pupil's family; and (4) the pupil's mobility rate as a function of the grade 
level at which the pupil first entered the school. 



Sunnn^ry of Findings 

The following is a summary of thp ■ effects of the b- ' r,>M-ri factors 

descr^ned above on pupil - ^des two and t 

ZHPJ::i_ '^^^ girls ouu.>... .ea the uuys on the Readlu^ uuu the wiU 

grade margin by which the girls lead the boys has generally narrowed over the 
last twc years on both means and percent scoring below the first quartile. 
The test achievement of both boys and girls continued to improve in 1977-78. 

English fluency . The percent of pupils who spoke only English decreased 
slightly during the three years covered in this report. The percent of pupils 
who spoke English and a second language increased slightly. The. highest 
reading test scores were made by pi'pils who spoke fluent English and a 
second language (excluding Spanish); students who spoke English only coming 
in second; and pupils who spoke limited English plus a second language scoring 
substantially lower than the other two groups. Of the pupils who spoke a 
second language, Spanish students scored the lowest on the reading test. 
Lastly, the mean scores of all language groups increased over the last two 
years. 

Socioeconomic level . The occupation of the principal breadwinner in the 
pupil's family was more closely related to reading test scores than any other 
factor. On the average the pupils from families at the highest socioeconomic 
levels achieved the highest scores on the reading tests, with the pupils 
from the families at the second highest socioeconomic level achieving the 
second highest scores, and so forth. The same pattern pravaJJLs with regard . 
to percent of pupils who scored below the first quartile, wich the pupils 
from the highest socioeconomic group being least represented in the lower 
quartile while the pupils from the lowest socioeconomic group were the most 
frequently represented. These trends have been consistent over time? with all 
groups, excluding unknowns and no-responses. Indicating an increase in mean 
scores over the last two years. Lastly, the within-grade gap between pupils 
in the highest and lowest - socioeconoa^-groups^ haa generally narrowed over 
t.ie last two years in both mean scores and the percent scoring below the 
first quartile. 

Pupil mobility . The pupils showed a consistent increase in mobility (that 
is, a greater tendency to change schools) over the last two years. The less 
mobile pupils scored higher than more mobile students. Thus, it appears that 
stability of enrollment is related to reading test achievement. However, one 
can see in Table 16 that socioeconomic level is* by far the most influiential 
factor, since there is no overlap bel-ween socioeconomic levels when mobility 
is included in the analysis. Finally, thfi gap between the more mobile pupils 
and the less mobile pupils has narrowtd over the last two years in both mean 
scores and the percent scoring below the first quartile. 
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Method of Analysis 

The reading achievement figures for pupils in grades two and three shown in 
this section are for 1975-76, 1976-77, and 1977-78. The achievement scores 
are further broken down to show the comparative scores between students having 

scores of pupils in grades two and thr*?.e are broken down into scores for boys 
and girls. 

Pupil achievement is expressed in two way?' ' as the mean reading test 
score, which is the average percent of r -^t answers for thr ar-oT'n: 

and (2y as the percent of students scoriu^. ow ^::e first quarts 
reading test, which is the percent of papi .6 within a student background 
characteristic group who scored in the bottom 25 percent of all pupils. 
For instance, in 1977-78 boys in grade three had a mean reading test score of 
80. 5, which means that they averaged 30.5 percent correct, answers on the test 
(see Table 12). Table 12 also contains the figure 28.3 for grade three boys 
who scored below the first quartile in the reading test in 1977-78, which means 
that 28.3 percent of the boys in grade three were in the bottom one-fourth of 
all third grade pupils tested. Both of these achievement reporting methods 
aid the reader in interpreting the findings in this report by allowing 
~QX±t±cai analyses of both the low scoring students and the group as a whole. 

Percent below first quartile . Any group of pupils can be divided into the 
fourths that scored highest, second highest, third highest, and lowest. The 
first quartile is the score that marks the border between the lowest and the 
next lowest forth of the pupils who were tested. One can then use this 
cutting point as a selection criteria to view the performance of various 
groups as follows. If any pupil subgroup is overrepresented in this scoring 
categorv, for instance mere than 25 percen^-.j then that subgroup is having a 
problem with the test. • 

For example, in Table 12 it can be seen that the boys have a higher percent 
in the lower scoring group than the girls (that is, 28.1 percent versus 21.9 
percent in grade two). This information coincides with the mean score 
differences between boys and girls (that is, 67.7 percent versus 71.2 percent), 
an indication that girls perform better on the test and indicates that the 
differences are more or less consistent across achievement levels. 

Sex of the pupils . Teachers were asked to designate the sex of each pupil 
on the pupil's test booklet as follows: 



SEX 



Boy O 

Girl O 
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Slightly more boys than girls were tested in 1977-78 in both grades two 
and three. Both sexes in both grades showed improvements in mean percent 
correct. Girls in second grade answered ar. average of 71.2 percent of the 
questions correctly, an increase of 0.3 percent correct over 1976-77. Girls 
in third grade answered 83.8 percent of r.he questions correctly, an improve- 
iuent of 0.3 percent. 

The improvement of the boys w.^s slightly better thar. that of the girls. 
Second grade boys averaged 6c. 7 percent correct, an increase of 0.6 percent 
over the previous year. In third grade boys answered 80.5 percent of the 
questions correctly, an improvement of 0.6 percent. More boys than girls 
scored below the first quart ile, and the percent of boys below the first 
auartile is greater in l:hird grade than in second grade. However, within 
graces these differences are growing smaller over time, 

E nglish language fluency . Teachers were asked to designate the languages 
that the pupil spoke as follows: 



ENGLISH LANGUAGE FLUENCY 

O English Only 



O Fluent English and 

O Limited English and - 

O^on -English speaking 
(was not tested) 



O Chinese 

O •^panese 

^ Philippine 
Dialects 

O Spanish 
O Other 



Anong the third grade pupils tested, 78.5 percent spoke English only, 14.3 
percent spoke fluent English and a second language, 6.0 percent spoke limited 
English and a second language, and 1.3 percent spoke no English (see Table 13) 
Spanish was the dominant second language (see Figure 17) a similar distribu- 
tion was found among second gravis pupils. From 1976-77 to 1977-78 fewer 
students spoke English only and more students spoke fluent or limited English 
ai\d another language. 

Generally, both second and third grade students have increased their mean 
reading scores over the last two years. The pupils who speak English only, 
performed above the statewide averages (see Table 13): second grade pupils ^ 
who spoke only English answered 72.7 percent of the questions correctly 
(compared with the statewide average of 68.9 percent); the third grade 
pupils who spoke only English answered 85.5 percent of the questions correctly 
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(82, 2 percent is the statewide average). Both second and third grade pupils 
who spoke fluent English as a second language and whose primary language is 
other than Spanish exhieved even higher scores than pupils who spoke only 
English (ste Figure 18). Particularly high achievement was shown by children 
who spoke fluent English and Chinese or Japanese. Pupils who spoke fluent 
English and Spanish scored c ons iderably below the s tat ew?.de averages y oO • ± 
percent correct in second grade and 75.6 percent correct in third grade. The 
average score of speakers of limited English vere sigiiif icantly below the 
statev^ide averages 

t ) of Khe breadwinner in the pupil's family . Teachers were asked to 
designate as folJows the occuoational category of the breadwinner in each 
pupil's family; 



SOCIOECONOMIC STATUS 

O Execunves, Professionals, and Managers 
Scmiprofessionals. Clerical and Sales 
Workers, and Technicians » 
O Skilled and Semiskilled Employees 
O Unskilled Employees (and Welfare) 
O Unknown 



The occupational information permitted a comparison of pupils' scores by the 
socioeconomic, level of their parents. The results are shown on Table 14 and 
Figure 19. Generally, aJ.l socioeconomic groups, excluding unknowns and no 
responses, have increased their mean reading scores over the last two years. 



Table- 14 shows the considerable achievement differences between children of 
different socioeconomic backgrounds. Children whose parents are in the more 
professional categories scored the highest in both second and third grades. 
Similar differences were noted in the percent of pupils who scored below the 
first quartile. In third grade 5.9 percent of the pupils whose parents were 
classified as professionals scored below the first quartile. In contrast, 
almost half (48.7 percent) of those whose parents were classified as unskilled 
or receiving welfare scored below the first quartile. Thus, a child from the 
lowest socioeconomic group was about eight times as likely to score below the 
first quartile as one from the highest socioeconomic group. However, the 
gap between the top and bottom socioeconomic groups is Marrowing Over time 
for both mean scores and percent of students scoring "jelow the first ' quartile. 

Pupil mobility . Teachers were asked to designate the grade in which each child 
first enrolled in the school as follows: 



Hi 

o 
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fOBILITY 

AT WHAT GRADE WAS THIS PUPIL 



kO 



FIRST ENROLLED AT THIS SCHODL? 2 O 



HAS THIS PUPIL BEEN FMROLLED 
IN THIS SCHOOL CONTINUOUSLY 
SINCE THAT TIME? 



YosO 
NoO 



This information permits a comparison of pupil scores by the length of time 
a pupil has attended his or her current school. The results are shown in 
Tables 15 and 16. Approximately half the pupils tested had not changed 
schools since their enrollment in kindergarten: 55 percent of the grade 
two pupils and 46.3 percent of the grade three pupils. However, about one- 
fourth of the pupils tested had moved to their current school durir^g the 
year of testing (25.8 percent of the second graders and 24.2 percent of the 
third graders). 

The mobility rates have continued to increase for both grades over the last 
two years (see Table 15). The percent of second grade pupils who remained 
in the same school since kindergarten decreased from 57,1 percent in 1975-76 
to 55 percent in 1977-78. Third grade pupils showed a similar decrease in 
enrollment stability from 48.4 percent to 46.3 percent for the same years. 
Similarly, more pupils in 1977-78 had been in their current school less than 
one year at the time of testing than in 1976-77. For second grade pupils this 
nunter increased from 25.6 percent in 1976-77 to 25.8 percent in 1977-78. 
For third graders it rose from 24.1 percent in 1976-77 to 24.2 percent in 
1977-78. . ^ ^ 



Pupils with stable enrollments (that is, longer enrollments at the same school) 
generally had higher test scores than those who bad been in the school a 
shorter time. Second grade pupils who were enrolled in the same schools 
since kindergarten scored 70.5 percent correct; those enrolled in the same 
school since first grade scored 68.2 percent correct; and those enrolled in 
the same school since second grade scored 66.2 percent correct. The patterns 
were similar for third graders. Third grade pupils who were in the same schools 
since kindergarten scored 84 percent correct; those in the same school since 
first grade scored 82.1 ^nprcent correct; and those in the same school since 
second grade scored 81.3 » »rcent correct; and' those enrolled that year scored 
79.4 percent correct. 

Part of the pattern of higher achievement among the pupils with more stable 
enrollments can be attributed to the fact that more of these children come 
from families with higher socieconomic status. This relationship can be seen 
in Table 16, which includes figures for both socioeconomic status and mobility. 



'us 



106 



Student Achievement in California Schools 



The data summarized in Table 16 indicates that mobility is mildlv rplat^ 

to pupil achievement, in that within each socioeco^ 

in mobility does corresponrl . , r. ^ 

^'•'■^ ' > . ♦ ica as execuL ive/professionals 

tc^ Li»c- lUijbL stable pupils from the next lower socioeconomic 
group, and this relationship is consistent for the other socioeconomic 
groups as well. 

Generally, the children of higher mobility made greater achievement gains 
than the children of more stable backgrounds, as shown in Table 15; thus 
continuing the closing of the gap between scores of the most and the least 
mobile groups. For example, second grade children who were enrolled in the 
same school since kindergarten scored 0.3 percent correct higher than their 
counterparts of 1976-77, while those who enrolled during the year the test 
was given gained 0.7 percent over their predecessors. Third grade children 
who were enrolled in the same school since kindergarten gained 0.4 percent, 
while those enrolled that year gained 0.6 percent. 



Table 12 
Reading Test Scores by Sex 



ex 


Year 


Percent of 
Population 


Mean Test 


Scores 


Change in Maans 


Percent Scoring 
Below First 
Quartile 


Change in Percent 
Scoring Below 
First Quartile 






Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade j 




1975-76 


50.3 


49.9 


65.2 


79.5 






28.3 


28.5 








1976-77 


50.0 


49.8 


66.1 


79.9 


+ .9 


+ .4 


28.2 


28.5 


- .1 


-0- 




1977-78 


50.3 


50.0 


66.7 


80.5 


+ .6 


+ .6 


28.1 


28.3 


- .1 


- .2 


rls 


1975-76 


49.3 


49.6 


70.0 


83.2 






21.6 


21.4 








1976-77 


49.1 


49.5 


70.9 


83.5 


+ .9 


+ .3 


21.7 


21.4 


+ .1 


. -0- 




1977-78 


49.3 


49.6 


71.2 


83.8 


+ .3 


+ .3 


21.9 


21.7 


+ .2 


+ .3 
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Table 13 

Readlnjt Tesc Scores by Engllgh Unguige Fluency and Other Language Spoken 



English Unguage 


other Languages 


Year 


Percent of 
Population 


Mean Test Score 


Change In Means 


Percent Scoring 
telow First • 
Quartlle 


Change In Percent 
Scoring Below 
First Ouartlle 


Plucncy 


Spoken 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Crade 3 


STATE TOTAL 




1975- 76 

1976- 77 

1977- 78 


100.0 
100.0 
100.0 


100.0 
100.0 
100.0 


67.7 
68.4 
68.9 


81.4 
81.7 
82.2 


+ .7 
+ .5 


+ .3 
+ .5 


25.0 
25.0 
25.0 


25.0 
25.0 
25.0 


-0- 
-0- 


-0- 
-0- 


English 




1975- 76 

1976- 77 

1977- 78 


79.2 
78.7 
78.0 


79.3 
78.8 
78.5 


/o.y 
72.0 
72./ 


84.3 
85.5 


+1.1 
+ .7 


-0- 

+1.2 


19.8 
19.3 
, 19.0 


19.7 
19.2 
19.0 


- .5 

- .3 


- .5 

- .2 


Fluent English 


Chinese 


1975- 76 

1976- 77 

1977- 78 


.5 
.5 
.6 


.6 
.6 
.7 


80.5 
81.9 
81.8 


89.3 
91.1 
90.4 


+1.4 
- .1 


+1.8 
- .7 ' 


8.4 
5.9 
7.5 


9.9 
7.4 
9.2 


-2.5 -2.5 
+1.6 +1.8 


-• 


Japanese 


1975- 76 

1976- 77 

1977- 78 


.4 
.4 
.4 


.4 
.4 
.4 


82.3 
82.8 
84.3 


91.7 
91.8 
91.9 


+ .5 
+1.5 


+ .1 
+ .1 


5.5 
5,1 
5.1 


6.4 
6.2 
6.7 


- .4 

-0- 


- .2 
+ .5 




Fhllipplne Dialects 


1975- 76 

1976- 77 

1977- 78 


.7 
.7 
.8 


.7 
.7 
.7 


74.5 
75.6 
77.5 

58.1 
59.1 
60.1 


85.6 
87.5 
87.7 


+1.1 
+1.9 


+1.9 
+ .2 


11.7 
11.7 
9.4 


16.6 
13.3 
13.5 


-0- 
-2.3 


-3.3 
+ .2 




Spanish 


1975- 76 

1976- 77 

1977- 78 


9.2 
9.2 
9.4 


10.3 
10.5 
10.3 


74.5 
75.0 
, .75.6 


+1.0 
+1.0 


+ .5 
+ .6 


36.8 
36.8 
36.3 


38.3 
38.6 
38.8 


-0- 
- .5 


+ .3 
+ .2 




Other 


1975- 76 

1976- 77 

1977- 78 


1.4 
1.5 
1.8 


1.6 
1.6 
2.0 


73.0 
74.2 
7^.8 


85.5 
86.1 
86.6 


+1.2 
+ .6 


+ .6 
■ + .5 


16.0 
15.1 

14.5' 


17.3 
16.6 
17.1 


- .9 

- .6 


- .7 
+ .5 




No Response 


1975- 76 

1976- 77 

1977- 78 


.2 
.2 
.2 


.2 
.2 
.2 


62.8 
63.3 
64.8 


79.1 
78.3 
78.0 


+ .5 
+1.5 


- .8 

- .3 


30.9 
33.9 
29.0 


33.1 
31.7 


+3.0 
■4.3 


+2.6 
-1.4 




Sub-Total 


1975- 76 

1976- 77 

1977- 78 


12.4 
12.4 
13.0 


13.8 
13.9 
• 14.3 


62.5 
63.5 
64.8. 


77.5 
78.1 
78.8 . 


+1.0 
+L3. 


+ .6 

.+ -7^ 


30.8 
30.6 
29.5 


, 32.6 
32.5 
32.2 


- .2 


- .1 

- .3 
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Table 13 (Cont.) 



Limited English 



Chinese 



Japanese 



Philippine Dialects 



Spanish 



Other 



I 



Non-English 
Speaking 



No Response 



No Response 



Sub-Total 



1975- 76 

1976- 77 

1977- 73 



1975- 76 

1976- 77 



1975- 76 

1976- 77 

1977- 78 



1975- 76 

1976- 77 

1977- 78 



1975- 76 

1976- 77 

1977- 78 



1975- 76 

1976- 77 

1977- 78 



1975- 76 

1976- 77 

1977- 78 



1975- 76 

1976- 77 

1977- 78 



5.1 
5.8 
6.0 



.5 
,6 
.7 



,1 
.1 
,1 



6.2 
7.0 
7.2 



1.4 
1.5 
1.7 



1975- 76 1 .8 

1976- 77 ,4 

1977- 78 



,2 
,2 
.2 



.2 
,2 
,2 



4.1 
4,7 
4.9 



5.0 
5.7 
6.1 



1.1 
1.1 
1.3 



.8 
.5 



56. i 
60.2 
61.6 



65.9 
66.1 



57.0 
60.0 
61.9 



42.1 
42.3 
42.2 



50.4 
53.3 
54.2 



46.4 
42.8 
47.2 



44.1 
44.6 
44.8 



68.6 
68.9 
62.0 



70,7 
71.9 
74.4 



77.2 
78.3 
75.3 



70.4 
71.6 
74.2 



54.5 
53.8 
54,7 



59.5 
63,6 
65,6 



57.4 
58.3 
58,9 



56.4 
56.2 
57,2 



29.1J 29,1! 

29.1; 29,1' 
lb 



29. r 29.1'' 



81.1 
82.5 
82.4 



+3,7 
+1.4 



+ .2 

Tj.6 



+3.0 
+1.9 



+ .2 
- .1 



+2.9 
+ .9 



-3,6 

^^.4 



+ .5 
+ .2 



-0. 
■0- 



+ .3 
•6.9 



+1.2 
+2.5 



+1.1 
•0- 



+1.2 
+2.6 



- .7 

+ .9 



+A.1 
+2.0 



+ .9 
+ .6 



• .2 

+1.0 



-0- 

-0- 



+1.4 
- .1 



38.3 
35.9 
31.1 



22.8 
23.6 
iS.3 



37.8 
34.0 
32.5 



67.3 
-68.0 
69.3 



48.9 
45,7 
46.4 



62.1 
68.7 
57.9 



63.3 
63.5 
64.5 



45,9 
46.2 
42.2 



34.1 
32.1 
34.2 



46.6 
45.5 
43.3 



74.3 
76.5 
75.7 



58.0 
60.7 
58.6 



68.1 
69.7 
69.9 



71.3 
72,6 
71.6 



lOO.of 100.0' 
lOO.Oj lOO.o' 
lOG.o'' lOO.o' 



23.2 
22.8 
37,5 



-2.A 
■4.8 



■D.J 



■3.8 
■1.5 



> .7 
+1.5 



■3.2 

+ .7 



+^.6 
■10.8 



+ .3 
+1.0 



■0- 

■0- 



-..4 
+14w7 



+ .3 
-4.0 



■2.0 



t 



Value ].es3 than .05 

The computed chance score for pupils who were unable to take the test 




Other languages 
(4,0%) 



Non-English speaking 
(1.3%) 



' Other languages 

(1.2%)' 



Distribution of California third grade pupils according to English hinguage fluency and other 
language spoken , as coded by their teachers 



English language 
fluency 



Percent correct, 1977-78 



30 40 50 60 70 80 90 100 



State total 

English only 

Fluent English total 
Chinese 
Japanese 
Philippine dialect 
Spanish 
Other 

Limited English total 
Chinese 
Japanese 
Philippine dialect 
Spanish 
Other 




Fig. 18. Reading Test scores by Engliafa language fhiency and 
other language st>oken , grade three 
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Table 14 

Reading Test Scores by Occupation of Principal Breadwinner in Pupil's Family 

f 



Occupation of Principal 
Breadwinr.T 


Year 


Percent of ./' 
Population 


III 

Mean Test Score 


Change in Means 


Percent Scoring 
Below First 
Quartile 


Change in Percent 
Scoring Below 
First Ouartile 




Grade 2 


Grade 3 


Grade. 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


STAII TOTAL 


1975- 76 

1976- 77 
19/7-78 


100,0 
100.0 
100.0 


100.0 
100.0 
100.0 


67.7 
68.4 
68.9' 


81.4 
81.7 
82.2 


+ .7 
+ .5 


+ ,3 
+ ,5 


25.0 
25.0 
25.0 


25.0 
25.0 

25.0 


•0- 

•0- 


-0- 
•0- 


Executive, Professional 
or Manager 


1975- 76 

1976- 77 

1QT7 TO 


15.3 
15.7 
15.1 


15.9 
16.5 
16.3 


83.0 
83.7 
84.4 


91.9 
92.1 
92.4 


+ .1 
+ .7 


+ ,2 
+ .3 


6.1 
6.0 
5.6 


6.1 
6.2 
5.9 


- .1 

- .4 


+ .1 
- .3 


Semiprofessional, 
Clerical, Sales Worker, 

or Tprhnif^ifln 


1975- 76 

1976- 77 

1977- 78 


21.3 
20.9 
21.1 


21,8 
21.5 
22,1 


75.8 
76.6 
77.1 


87.8 
88.1 
88.5 


+ .8 
+ .5 


+ .3 
+ .4 


12.5 
12.4 
12.4 


12.8 
12.6 
13.0 


- .1 
-0- 


r .2 

+ .4' 


Skilled or Semiskilled 
Employee 


1975- 76 

1976- 77 
197/-78 

^' 

1975- 76 

1976- 77 

1077 70 


36.5 
36.3 
36.S 


36.8 
36.4 
36.2 


66.0 
67.1 
67,7 


81.0 
81.4 
81,9 


+1.1 
+ .6 


+ .4 
+ ,5 


25.4 
25.2 
25.0 


25.4 
25.5 
25.6 


- .2 

- .2 


+ .1 
+ .1 


Unskilled Employee 


19.3 
19.1 
19.1 


18.1 
18.2 
17.6 


52.9 
53.8 
54.6 


68il 
68.7 
69.6 


+ .9 
+ ,8 


+ .6 
+ .9 


47.6 
/(7.6 
47.1 


49:7 
49.4 
48.7 


-0- 
- .5 


■ .3 
- .7 


Unknown 


1975- 76 

1976- 77 

1977- 78 


6.2 
6.6 
6.7 


5.9 
6.0 
6.3 


56.6 
56.8 
56.8 


71.5 
71.5 
70.7 


+ .2 
-0- 


-0- 

- ;8 


41.9 
4].0 
44.2 


42,7 
43.2 
45.7 


+l.t 

+1.2 


+ .5 
+2.5 ■ 


No Response 


1975- 76 

1976- 77 

1977- 78 


1.3 
1.4 
1.6 


1.5 
1.4 
1.6 


; 

65.9 . 80.3 
65.6 79,. 2 
63.2 79.0 


- .3 ' 
-2.4 


-1.1 

.2 


27.1 
28.8 
33.6 


26.7 
29.5 
30.8 


+1,7 
H.8 


+2.8 
+1.3 . 



I2i 

3 



ERIC 



Occupation of 

principal 
breadwinner 



Percent correct, 1977-78 



30 40 50 60 70 80 90 100 

—I 1 I I I I I 1 



GRADE 2 

State total 

Executive, profes- 
sional, or manager 

Semiprofessional, 
clerical or sales 
worker, or 
technician 

Sidlled or semi- 
skilled employee 

Unskilled employee 
(or on welfare) 



GRADE 3 
State total 

Executive, profes- 
sional, or manager 

Seniiprofessior?i, 
clerical or sale^ 
worker, or 
technician 

Skilled or semi- 
skilled employee 

Unskilled employee 
(or on welfare) 



Fi^. 19. Reading Test scores by occupation of principal bread- 
winner in pupil's family, grades two and three 
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Grade in Which Pupil 
Has Enrolled in 
School of Testing 



STATE TOTAL 



Kindergarten 



Grade 1 



Grade 2 



Grade 3 



No ResDonRA 



Table 15 

Rg«ding Test Scores by Mobility Rate 



Year 


Percent of 
Population 


Mean Test Score 


Change in Means 


Percent Scoring 
BeloK First 
Ouartile 


Change in Percent 
Scoring Belov 

First OiinrHla 




Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


Grade 2 


Grade 3 


1975- 76 

1976- 77 

1977- 78 


100.0 
100.0 
100.0 


100.0 
100.0 
100.0 


67.7 
68.4 
68.9 


81.4 
81.7 
82.2 


+ .7 
+ .5 


+ .3 
+ .5 


25.0 
25.0 
25.0 


25.0 
25.0 
25.0 


-0- 
-0- 


-0- 
-0- 


1975- 76 

1976- 77 

1977- 78 


57.1 
56.1 
55.0 


48.4 
47.7 
46.3 


69.4 
70.2 
70.5 


83.4 
83.6 
84.0 


+ i8 
+ .3 


+ .2 

+ .4 


22.0 
' 22.3 
22.6 


21.5 
?1.7 
22.0 


+ .3 
+ .3 


+ .2 
+ .3 


1975- 76 

1976- 77 

1977- 78 


17.1 
17.5 
18.3 


13.1 
12,6 
13.0 


66.2 
67.3 
68.2 


81.3 
81.3 
82.1 


+1.1 
+ .9 


-0- 
+ .8 


27.1 
26.6 
26.0 


25.0 
25.9 
25.4 


- .5 

- .6 


+ .9 
■ .5 


1975- 76 

1976- 77 

1977- 78 


24.7 
25.6 
25.8 


14.3 
14.8 
15.7 


64.3 
65.5 
66.2 


80.2 , 

80.6 

81.3 


+1.2 
+ .7 


+ .4 
+ .7 


30.3 
29.7 
29.2 


'27.0 
27.0 
26.4 


. .6 
- .5 


-0- 
■ .6 


1975- 76 

1976- 77 

1977- 78 




23.2 
24.1 
24.2 




77.9 
78.8 
79.4 




+ .9 
+ .6 




30.8 
29.7 
29.6 




-1.1 ' 
■ .1 


1976- 77 

1977- 78 


1 1 

lit X 

.8 
.8 


.8 
.8 


ft t 

Of. 4 

65.6 
65.1 


76.5 
78.6 
78.8 


+1.2 
- .5 


+2.1 
+ .2 


28.8 
30.1 
30.8 


3A.0 
31.5 
31.1 


+1.3 
+ .7 


■2.5 
■ .4 
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Table 16 



Statewide Mean Scores on Reading Test, by Socioeconomic Status and Mobility Rate, 

Grade Three 
1977-78 



Occupation of 
principal breadwinner 



Executive, professional, 
or manager 



Semiprofessional, 
clerical, sales worker, 
or technician 



Skilled or semiskilled 
erii/loyee 



Unskilled employee or 
on welfare 



Grade in which pupil 

was enrolled In 
school where tested 



Kindergarten 
Grade 1 
Grade 2 
Grade 3 

Kindergarten 
Grade 1 
Grade 2 
Grade 3 

Kindergarten 
Grade 1 
Grade 2 
Grade 3 

Kindergarten 
Grade 1 
Grade 2 
Grade 3 



Percent of 
pupils by 
grade level 



1977-78 



51.6 
13.5 
15.2 
19.7 

47.6 
13.3 
16.0 
23.1 

48.2 
12.5 
15.7 
23.6 

41.6 
13.6 
16.2 
28.5 



Percent scoring 
below first 
quartlle 



1977-78 



4.8 
6.1 
6.7 
8.1 

11.6 
13.3 
13.3 
15.3 

24.2 
26.0 
26.0 
27.8 

44.5 
49.5 
51,7 
52.7 



Mean Readin}^ 
Test score 



1977-78 



93.0 
92,5 
92.1 
91.0 

89.2 
88.5 
88.3 
87.3 

82.8 
81.7 
81.5 
80.5 

72.3 
69.5 
67.8 
66.7 



Percent correct, 1977-78 



30 40 50 60 70 80 90 100 



Student Level Analysis of Achievement and Background Factors, 

Grades Six and Twelve 

As part of the administration of the Survey of Basic Skills ^ sixth grade 
teachers provided information on the English language fluency of each student 
and any second language that the student spoke. Both sixth and twelfth 
grade teachers also provided information un the sex of the student. These 
factors were then analyzed to determine whether any differences exist be- 
tween students grouped by these characteristics. 

Summary of Findings 

1. Reading and math test scores were higher for students who spoke 
fluent English plus either Chinese or Japanese than for those 

\Ao spoke English only. Students who spoke limited English scored 
far below the others. The reading test scores of all students, 
except those who spoke limited English plus Japanese, increased 
from last year; and mathematics scores increased for all the groups. 
Lastly, the gap between the students who spoke English only and 
those who spoke a second language decreased since last year. 

2. Both boys and girls increased their reading and mathematics scoros 
from last year in grade six. but readirtg scores decreased for 
twelfth grade students. The gap between the boys and the girls 
narrowed in reading in both sixth and twelfth grades. 

Analysis of Findings 

English language fluency . Figure 20 contains the percents of pupils that 
fell within the various categories of fluency in English and the p/^rcents 
of students who spoke other languages. The reading and mathematics scores, 
by fluency in English and any other language that the student spoke are 
presented in Table^l? and are shown graphically in Figure 20 . 

Overall reading scores increased by 0.4 percent correct between 1976-77 and 
1977-78. The data for reading shows that all students more or less followed 
the statewide trend — except limited English pupils who spoke Japanese, whose 
score declined. The biggest gains were made by students who spoke a second 
language,' narrowing the gap in mean scores between the English only students 
and those who spoke a second language. 




ii6 Pupil Subgroup Analysis, Grades Six and Twelve 

Overall mathematics scores increased by 0.8 percent between 1976--77 and 
1977-78, and this instituted an increase in all categories. Parallel to 
reading, fluent-English-speaking students who spoke Chinese, Japanese, or 
a Philippine dialect " scored above the English only students. Further, 
in the area of mathematics even the limited-English-speaking students who 
spoke Chinese or Japanese scored above the English-only students. This 
seems logical since one could view mathematics as a somewhat language inde- 
pendent subject matter. 

Sex differences . Both reading and .mathematics scores in sixth grade increased 
from last year (see Table 18). In twelfth grade, reading scores declined 
from last year, with girls declining the most; reducing the gap between the 
Sfcxes in reading. However, in mathematics there were no changes from last 
year: boys continue to score above girls, and quite subs tartially so at grade 
twelve. 
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Table 17. 



Survey of Basic Skills Scores for Reading and Mathematics by English Language ?Iuency 

Grade Six 
1975-76, 1976-77, and 1977-78 



English Language 
Fluency 


Other Language 
Spoken 


Percent 

of 
Pupils 


Reading 




Mathematics 






1 rtic 1/ 

1975-76 


1976-77 


1977-78 


Change 

75- 6 76-7 
to to 

76- 7 77-8 


1975-76 


1976-77 


1977-78 


Ulc 

75- 6 

to 

76- 7 


luge 

76- 7 

to 

77- 8 


oL&ce lotai 




100.0'^ 


66.1 


65.9 


66.3 


. .2 


t 4 


57.4 


57.7 


58.5 


+ .3 


+ .8 


iiugiisii uniy 




75.2 


68.2 


68.2 


68.6 


•0- 


+ .4 


58.5 


59.1 


59.7 


+ .6 


+ .6 


Fluent English 


Total 


14.7 


58.6 


58 5 


59 6 


- .1 


+1.1 


52.2 . 


JJiU 


jf . J 


+ .8 


+1.5 ' 




Chinese 


.6 


73.4 


73.9 


75.5 


+ .5. 


.+1.6 


69.3 




79 Q 
U,i 


+1.7 


+1.9 




Japanese 


.3 


76.6 


76.2 

f V 1 !■ 


78.0 


■ .4 


+1.8 


68.9 




/U.J 


+ .6 


+ .8 




rniuppine Dialect 


.7 


64:3 


64.9 


67.8 


+ .6 


+2.9 


58.0 


59.0 


61.6 


+1.0 


+2.6 




opanisn 


1 A 0 

10. 0 


55.7 


55.5 


56.3 


- .2 


+ .8 


49.3 


50.0 


51.2 


+ .7 


+1.2 




uctier 


2.0 


66.3 


65.7 


66.7 


- .6 


+10 


58.8 


60.6 


61.4 


+1.8 


+ .8 


Limited Enflish 


Total 


1 7 


38.7 


37.8 


39.2 


- .9 


+1.4 


43.2 


43.3- 


44.3 


+ .1 


+1.0 




Chinese 


.1 


43.9 


43.4 


44.4 


- .5 


+1.0 


60.0 


59.4 


61.4 


- .6 


+2.0 




Japaiiese 


.0' 


44.5 


52.3 


48.8 


+7.8 


•3.5 


60.9 


66,1 


72.7 


+5.2 






Philippine Dialect 


.1 


44.4 


47.2 


49.5 


+2.8 


+2.3 


48.5 


47.5 


50.2 


-1.0 


+2.7 




Spanish 


2.9 


38.0 


36.7 


37.9 


■1.3 


+1.2 


40.6 


40.6 


41.6 


-0- 


+i.a 




Other 


.5 


39.4 


39.1 


43.5 


- .3 


+4.4 


52.8 


52.5 


54.5 


■ .3 


+2.0 



Includes .9 percent who were identified as non-English speaking and 6.3 percent noa- response. 



English only 
(75.2%^ 



No response ^^s^ / IK \ \ y/ 

(6.3%) ^^'"^•■■■--/^ \ \ Other languages 

Non-Englishi speakinT^^*"^ iVA-^'^Mimited ^^'^^"^ 

(0.6%) Other languages \ English 

(0.8%) Spanish (3.7%) 
(2.9%) 

Fig. 20. Distribution of California grade six students according to Engl? ih language fluency and other 
language spoken, as coded by their teachers 



English language 
fluency 




State total 



^noltch nnli/ 
---D 



Fluent English total 
Chinese 
Japanese 

Philippine dialect 

Spanish 

Other 

Limited English total 
Chinese 
Japanese 
Philippine dialect 
Spanish 
Other 



Fig. 21. Survey of Basic Skills reading scores by English language 
fluency and other language spoken, grade six, 1976-77 
and 1977-78 
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Table 18 



Survey of Basic Skills Scores for Reading and Mathenatlcs by Sex 
Grades Six sod Tvelve 
1975-76, 1976-77, 1977-78 



JCA 


Grade Six 


Grade Tvelve 


Reading 


Mathematics 


Reading 


Mathematics 


75-6 76-7 77-8 


Change 

75- 6 76-7 
to to 

76- 7 77-8 


75-6 76-7 77-8 


Change 

75- 7 76-7 
to to 

76- 7 77-8 


75-6 76-7 77-8 


change 

75- 6 76-7 
to to 

76- 7 77-8 


75-6 76-7 77-8 


Change 

75- 6 76-/ 
to to 

76- 7 77-8 


State Total 

Boys* 

Girls'* 


66.1 65.9 66.1 
64.7 64.5 65.0 
67.7 67.2 67.6 


- .2 + .4 

- .2 + ,5 

- .5 + .4 


57.4 57.7 58.5 

57.5 57.9 58.7 
57.2 57.5 58.3 


+ .3 + .8 
+ .4 + .8 
+ .3 + .8 


64.1 6J.6 63.3 
64.0 63.4 63.3 
64.3 63.8 63.4 


- .5 - .3 

- .6 - .1 

- .5 - .4 


67.0 68.3 66.3 
69.4 68.7 68.7 
64.0 63.9 63.9 


■ .7 

-.7-0- 
- .1-0- 



Vys represent 50.5 percent of the students tested in grade six and 49.5 percent of the students tested in grade 
twelve. 



Girls account for 49.5 percent of the students tested in grade six and 50.5 percent of the students tested in grade 
tvelve. 
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VIL Comparisons with National Norms 



Some of the difficulties in using publishers' national norms to judge the 
adequacy of the performance of California students are discussed in Chapter 
II. Briefly, the two main problems are (1) lack of agreement among publi- 
shers' samples; and (2) lack of timelin€8s<» Any comparison based on a single 
publisher's norm group (a national sample of students tested at p given time) 
can be quite misleading and is a tenuous undertaking at best. Since no test 
is given nationwide, one must rely on various publishers' estimates of the 
nationwide distribution of tesj^ scores. These estimates vary from publisher 
to publisher and are clearly "guesstimates," Part. of the problem in esta- 
blishing norms is that publishers are dependent upon the goodwill and coopera- 
tion of the districts they select to administer their tests. When the . 
districts that have been carefully selected as part of a national sample 
decline to participate In the norming study, the results become that much more 
uncertain. In addition, because of the expense involved, publishers are not 
able to update their norms more than once every five to eight years. 

To cope with this situation, the Department of Education compares the perfor- 
mance of California students with the norms of a variety of tests and updates 
the comparisons whenever the tests are renbrmed or when new tests become 
available. This is done by giving a sample of California students both the 
publisher's standardized test and the California test. In some cases no 
extra testing is required. Scores for a publisher's standardized test are 
simply collected. from the school districts that administered the test to all 
of t^eir students in certain schools for other purposes. The statistical 
techniques used to equate the two tests are briefly described in Appendix H. 
The result of this type of "equating study" is to show how California students 
would have compared to a national norm group if, in fact, all California 
students had taken the published test. 

This approach has several advantages: (1) the national comparisons are more 
timely since they can be updated as new norms become available; (2) the esti- 
mates are more stable since they do not depend on the representativeness tof . 
a single publisher's sample; and (3) the progress of California students cart 
be assessed with a test that fits the objectives of the instructional program 
and simultaneously, with no additional testing, can be compared to national 
norms. > - 

The new comparisons presented in this report are based on the tests with the 
most recent national norms available. This report also contains the results' 
of earlier equating studies so that the reader can inspect the long-term (from 
eight to twelve years) achievement test trends in California against the 
backdrop of national norms. 



l3o 



122 



Student J^nhievement in_ California Schools 



Grades Two and Three 

Table 19 contains the estimated national percentile ranks of the medians of 
Calif omia^second and third^rade pupils' performance on the Reading Test 
since 1965-66. The trend over the years is clearly one of growth, with 
the second grade scores increasin3 from the' 28th to the 38th percentile 
rank on the Stanford Reading Test , from the 50th to the 53rd on the 
Cooperative Primary Reading Test , and now from the 54th to the 55th on the 
Comprehensive tests o Basic Skills ( CTBS ) . Siifi^arly, third grade per- 
formance climbed from the 34th percentile to the 57th percentile. Figure 
22 is a pictorial display of these trends. 

The following observations should help the reader understand more fully the 
national comparisons. 

1. The second grade results for 1965-66 through 1969-70 and the third 
grade results for 1966-67 through 1970-71 were based on the Stanford 
Reading Test which was administered to all pupils at those grade 
levels in California. The norms for the Stanford Reading Test were 
established in 1963. Thus, the gains that occurred each year are 
relative to those norms. 

2. The second grade results for 1970-71 through 1972-73 and the third 
grade results for 1971-72 and 1972-73 were based on the Cooperative 
Primary Reading Test (CERT), which was administered to all pupils 
at those grade levels in California. The norms for the CPRT were 
established in 1966. The dramatic increase of scores in the 
changeover years was due largely to the great differences between 
the norms of the Stanford Reading Test and those of the CPRT. 

3. In 1973-74 the California Assessment Program developed the Reading 
Test . A systematic sample of one-ninth of all students tested in 
grades two and three was used in an equating study to estimate 
the performance of the median pupil in California relative to 

1966 Cooperative Vrimar:y Reading Test norms. The results indicated 
little change from. Lhose of the previous year. 

4. In 1974-75 the -Reading^ Test was revised and administered to all 
second and third grade pupils in California. The same test was used 
in 1975-76, 1976-77, and 1977-78. The results of an equating study, 
described in Appendix"!!, were used to estimate the performance of 
California pupils in comparison to the norms established in 1973 for 
the Comprehensive Tests of Basic Skills . (dBS), Form S. As a 
resTult of the modest increases over the last three years, the median 
for California pupil performance in grades two and three in 1977-78 
was at the 55th and 57th percentiles, respectively, based on the 
CTBS 1973 norms. 



Grade Six 



The performance of sixth graders in California declined in the early 19708 
and leveled off in 1974. It has climbed steadily since then. Table 20 
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shows that the median California sixth grade student's performance in 1977-78 
was slightly above the national swnple tested in 1973 by the makers of the 
Comprehensive Tests of Basic Skills. Figure 23 is a graphic representation of 
these trends. Reading performance, witl. a percentile rank of 55, continued to 
be slightly higher than that of language (51) and mathematics (53). 

A more complete description of these findings is given below: 

1. From 1969-70 to 1973-74 the Comprehensive Tests of Basic Skills 

(Form Q, 1968 norms) was administered to all California sixth grade 
students. During this period the performance of California students 
declined from four to nine percentile ranks on the basis of the 1968 
norms 



2. In 1974-75 the first version of the California Assessment Program 
test, the Survey of Basic Skills , was administered statewide. An 
equating study that was conducted that year showed that scores had 
improved and that if the Comprehensive Tests of Basic Skills had 
been administered statewide, the percentile ranks would have gone 
up to 48, 43, and 44 for reading, language, and mathematics re- 
spectively, 

3. A revision of the Survey was administered in 1975-76, 1976-77, and 
1977-78. An equating study, described in Appendix H, showed that 
on the basis of the 1973 version of the CTBS . California students 
improved enough in 1975-76 to equal or exceed the national average 
in reading and mathematics. Following the upward trend of 1976-77, 
in 1977-78 the reading score percentile rank-moved up to 55, and 
the improvement in language and mathematics achievement boosted 
the percentile ranks to 51 and 53, respectively. 



Grade Twelve 



The performance of twelfth grade students in California has been declining 
consistently since testing began in 1969-70. By 1976-77 the median high school 
senior was at the 42nd, 33rd, and 43rd percentile ranks in reading, written 
expression, and mathematics, respectively, on the basis of the Iowa Test of 
Educatio nal Development vlth its 1962 norms. On the basis of tests with more 
recent norms the ranks were even lower (see Table 21). 

Results for 1977-78 were mixed. Reading continued to decline with percentile 
ranks of 42, 32, and 35 for the three tests used to establish national comparisons. 
An improvement in written expression scores brought the percentile rank to 34 
26, and 28. Mathematics held steady at 43, 41, and 43. ' 
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'Table 19 ' 

EstlMted National Percentile Ranks of Median California Pupil Performance 

1965-b6 through 1977-78 
Grades Tvo and lliree 





Test administered 


Grade 


Stanford Reading Test 


Cooperative Primary 
Reading Test 


Reading 
Test^ 


Reading Test^ 
(Revised) 




1965-66 


1966-67 1967-68 1968-69 


1969-70 


1970-71 


1971-72 1972-73 


1973-74 


1974-75 


1975-76 1976-77 1977-78 


Grade 2 


28 


30 32 36 


38 


50 


53 53 


53 


54 


54 55 55 


Grade 3 




34 34 36 


36 


38 


52 52 


52 


55 


55 56 57 


Norms : 


Stanford, 1963 norms 


CPRT; 1966 norms 


CTBS, 1973 norms 



I 

Tlie new California test, the Reading Test , was administered in 1973-74. Hie percentile ranks are based on an equating 
of the Reading Test and the Cooperative Primary Reading Test . Forms 23A and 23B, nomed in 1966. 

The revised Reading Test was administered to all California pupils in 1974-75, 1975-76, 1976-77, and 1977-78. The 
percentile ranks are based on equating studies of the revised Reading Test and the Comprehensive Tests of Basic Skills . 
ForaS, nomed in 1973. 



Testing did not begin in grade three until 1967. 



13: 



65^ 



99 



66*67 



67 68 



68-69 



69-70 



70-71 



71-72 



72-73 



73-74 74-75 



75-76 



76-77 



77-78 




Key: 



O Stanford Achievement Test (1963 norms) 

A Cooperative Primary Reading Test (1966 norms) 

X Reading TVsr- equated to CPRT (1966 norms) 

□ Reading Test {Revised)-equated to CTBS (1973 norms) 



Fig. 22. National percentile ranks of median California pupil performance, 1965-66 through 1976-77. 
grades two and three 
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Table 20 



Estimated National Percentile Ranks of Median California Student Performance 

1969-70 through 1977-78 
Grade Six 





Test administered 


Content 
area 






Survey 


Survey of Basic 
Skills^ 
(Revised) 


Comprehensive Tests of Basic Skills 


of 

Basic 
Skills^ 




1969-70 


1970 71 1971-72 1972-73 1973-74 




1975- 


76 1976-77 1977-78 


Reading 


48 


46 44 44 , 44 


48 


53 


53 55 


Language 


43 


43 39 39 37 


43 


49 


51 51 


Mathematics 


47 


43 38 38 38 


44 


50 


51 53 

< 


Norms: 


CTBS, 1968 noms 


CTBS, 


1973 norms 



The new California test, the Survey of Basic Skills; Grade Six , was first administered to 
all California pupils in 1974-75. The percentile ranks are based on an equating of the 
Survey of Basic Skills and the Comprehensive Tests of Basic Skills (CTBS ), Form Q, which 
was normed in 1968. 



The revised version of the Survey of Basic Skills; Grade Six was administered in 1975-76, 
1976-77, and 1977-78. The percentile ranks are based on an equating of the revised Survey 
of Basic Skills and the Comprehensive Tests of Basic Skills (CTBS) , Form S, 1973 edition,' 
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69-70 70-71 71-72 72-73 73-74 74-75 75-76 76-77 
1 1 1 1 I I ■ 



77-78 



99 



54 

.J 
48 
46 
44 
42 
40 
38 



99 



54 
52 
50 
48 
46 
44 
42 
40 
38 



99 



54 
52 
50 
48 
46 
44 
42 
40 
38 




Key: 



O Comprehensive Tests of Basie Skills (1968 norms) 
□ Comprehensive Tests oj Basie Skills (1973 norms) 



Fig. 23. National percentile ranks of median California pupil performance, 1969-70 
through 1977-78, grade six 
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Table 21 



Estimated National Percentile Ranks of Median California Student Performance 

1969-70 through 1977-78 
Grade Tvelve 



Test administered 



Content 
area 


Iowa Tests of Educational Development 
Form X, Normed in 1962 


Survey 
of 

Basic 
Sklllsfl 


Suney of Basic 
Skills^ 
(Revised) 




1969-70 


1970-71 1Q71-79 


1Q7^-7A 

1.71 J' m 


1974-75 


1975-76 1976-77 


1077 70 


Reading 
















1970 noma 
Language 


52 


49 4$ 47 


47 


41 
33 
34 


43 
35 
38 


42 
33 
36 


42 
32 
35 


ITED. 1962 norms 
TAP, 1970 norms 
STEP. 1970 norms 


42 


40 38 36 


34 


32 
25 
27 


34 
27 
29 


33 
26 
28 


34 
26 
28 


Mathematics 
















ITED. 1962 norms 
TAP, 1970 norma 
STEP. 1970 norms 


48 


48 48 48 


48 


41 
38 
41 


44 
43 
44 


43 

41 . 
43 


43 
41 
43 



* The new California test, the Survey of Basic Skills! Grade TVelve was administered to dl California 
students from 1974-75 through 1977-78. Ihe percentile ranks are based on equating studies of the 
Survey of Basic Skills and three other tests with national norms: (1) Iowa Tests of Educational 
Development . Form X-4. normed in 1962; (2) Tests of Academic Progress , normed in 1970; and (3) Sequential 
Tests of Educational Progress . Series II, nomed in 1970, 



69-70 70-71 71-72 72-73 73-74 74-75 75-76 
— 1 L 1 I I I 1 



76-77 77-78 
1 u_ 



99 



.S 



It 



52 
50 
48 
46 
44 
•42 
40 
38 
36 
34 
32 



-o 




99 



8? 52 
5 50 

2 46 
44 

42 
40 
38 
36 
34 
32 
30 
28 
26 

• T 



o- 



-o- 



•o- 



■o- 




99 



so 

48 
46 

4^/ 
42 
40 
38 
36 
34 
32. 
♦ 



■O- 



-o- 



■o- 



-o 




Key: 



O fowa Tests oj Educational Development (1962 norms) 

□ Sequential Tests of Educational Progress, Series 11 (1970 norms) 

A Tests of Academic Progress (1970 norms) 



Fig. 24. National percentile ranks of median California pupil performance, 1969-70 
through 1976-77, grade 12 
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APPENDIX A 



Reading Perfonunce, by Skill Area, of California Second- and 
Third-Grade ftiplh, 1974-75, 1975-75, 1976-77, and 19/7-78 



Skill area 



Description of skills assessed 



TOTAL READING TEST 



I. WORD IDENTIFICATION 



I A, Sight vords 



^ B, Phonetic analysis 
w 

( 



I. Consonants 



2. Vowels 



(Total and ivuagei for word 
identification skill areas) 

Ihe pupil oust choose che word 
that naoes the object which is 
pictured, 



No, of 
itens 



(Total and averages for phvnetic 
analysis skill area, a subcate- 
gory of word identification) 

Ihe pupil mat choose the word 
that has a letter that is not 
sounded. 



Ihe pupil laist choose the 
printed word that has the sane 
vowel sound as the oral stimulus 
word, 



(250) 
(60) 

5 



(45) 



20 



Average percent of questions answered correctly 



Grade two 



1974-5 



(57.6) 
(75.4) 

83,9 



(76.5) 



73,-9 



1975-6 



(67,7) 
(75.5) 

84.5 



(76.5) 



73.? 



1976-7 



(58.4) 
(76.2) 

85.4 



1977-8 



(68.9) 
(75.5) 

85.9 



(77.1) 



74.8 



3.3, 



(77.4) 



75.1 



81,4 



Grade three 



1974-3 



(81.3) 
(85.8) 

92,7 



(86.1) 



84.5 



1975-6 



(81.4) 
(85.6) 

92.6 



87.8 



83.8 



8.1 



1976-7 



(ai.7) 

(85.9) 
92.9 



.2)' 



1977- 



(82,2) 
(86.3) 



93.5 



(86,5.1 



8.6 



Illustrative test quesdon' 



Teacher says; "Hark Che word, 
that goes best with the picture." 



0 spool 
0 spoon 
0 stool 




Teacher says: "Hark the wrd that 
has a letter that la not sounded." 

0 tieht 

OUft 
0 spent 

Teacher aayt; "Hark the word that 
has the aoaie vovel sound in Ita 
Diddle as Che vowel sound In the 
void run." 

• Ocut ' 
0 ran 
Ofia 



^ The only vaj^ presented in this co\m are averages. The percentages for individual items varied froa the average value by 20 or Dore points 
py XL" ^^^^^^^^^^ ' - ^» -aarlly , 









Average percent of quastlons answered correctly^ 




Skill .irtM 


Description uf skills assessed 


No. of 
Items 


Grade two 


Grade three 


Illustrative test question^ 








1974-5 


1975-6 


1976-7 


1977-8 


1974-5 


1975-6 


1976-7 


1977-8 




]. Spelling 
pitterna 


Ihe pupil oust choose the 
printed word that rhyiaes vith 
the oral atloulua word* 


10 


72,9 


72,7 


72,8 


72.8 


84.9 


84.9 


85.1 


85.0 


Teacher says: ''Mark the vord 
that rhynes vith the underlined 
word." 

show 0 blow 
0 down 
0 cow 


C. Stnictural 
analysis 


The pupil must Identify root 
words, suffixes ) cotnpouTid wis^ 
and contracticnii. 


10 


6S.e 


66,3 


67,5 


67,9 


80.9 


80.8 


H,l 


81.8 


Teacher says: 'Hirk the comblna^ 
tion of letters Chat is the 
correct division of the under^ 
lined word.'' 

flrehouse 0 fi + rehouse 
0 fire + houae 
0 firch + ouae 


II. VOCABULARY 


(Total and averages for vocab- 
ulary skill areas) 


(60) 


(67,7) 


(67.6) 


(68,6) 


(69,1) 


(82.5) 


(82.9) 


(83.4) 


(83,9) 




A. Denotation 

1 


The pupil must choose the 
response word that b^t fills 
the blank in the s^ntehie. 

( \ 


22 


63.8 


68,9 


69.6 


70.2 


84.0 

1 


83.6 


84.6 


84.9 


Teacher says : "Hark the vord 
that goes in tho ' lank in the 
sentence. 


T 




















Father told Pat to the 

back door. 

0 leave 
0 fast 

0 close 


fi. Relational 


(To:al and averages for rela- 
tio:ial skill areas, a sub- 
category oi vocabulary) 


(38) 


(67.0) 


(66.8) 


(68.0) 


(68.5) 


(81.8) 


(82.5) 


(82.7) 


(83.3) 




1. Synonyntf 


The pupil must choose the re- 
sponse word that qcms the same 
as the underlined word in the 
phrase. 


24 


57.6 


67.0 


68.3 


68.6 

1 


83.2 


83.5 


83.9 


84.4 


Teacher says: "Hark the vo.*>d 
that loeans the sane as the vord 
that la underlined.'' 

a stnall dog 0 cute 
0 little 
0 happy 
0 funny 
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Averige percent of questions answered correctly^ 




Skill area 


Description of skills assessed 


No. of 
Iteios 




Grade two 




Grade three 


Illustrative test question^ 








I974-: 


l975-( 


) 1976- 


^ 1977-B 


1974-: 


) 1975-f 


I976-] 


1977-8 




2. Antonyoi 


The pupil mt chooBe the re- 
sponse vord thit iDeina the 
oppoalte of the printed 
atimilus vord. 


10 


65.7 


65.7 


67.2 


66.0 


78.4 


t-0.4 


80.1 


81.0 


Teacher iiys: "Hark the vord 
that iwaas the opposite of the 
underlined vord." 

light 0 evening 
0 dark 
0 bright 


3. HoiQon)rni5 


Although the fonnat of this 
test iteoi Is Che aioe aa that 
used for denotation, the pupil 
mst choose the 'response word 
from aaung three having the 
some sound. 


4 


66.5 


67.2 


63.6 


68.8 


82.4 


81.5 


81.9 


82.3 


Teacher says: "Hark the word 
that goes in the blank in the 
sentence." 

We have dogs. 

0 to 
0 too 
0 two 


TTT TiIMLiUIi'UCMC TOM 


(Total and averages for coopre- 
hension skill areas) 


(110) 


(61.3) 


(61.3) 


(62.4) 


(62.8) 


(77.0) 


(76.7) 


(77.1) 


(77.6) 




]- A. Literal 

Z 
1 


Given a passage of printed 
niaterial) the pupil must choose 
the correct response to a 
written question thflt requires 
Identifying or reaciiferlng 
elements in the passage vhich 
were explicitly stated, 


77 


62.5 

1 


62.3 


63.4 


63.8 

1 

1 
1 


77.9 


77.5 


78.0 

1 


78.5 


Dear Children: 

I hope that you are having a 
good tlao and vorking hard. I 
have mlBsed the whole class 
varyniuch. Hiss Smith has been 
telling toe that you have been ' 
very helpful to her. 

Ihank you for all your cards 
and f lovers. I h^vo even had 
a few surprise vlsiia from sonie 
of youi 

I hope to be bac; as youi' 
teacher soon. Itatll then, your 
get veil cards made me think of 
you. 

Your teacher^ 
Hrs. Black 

What have the children sent Hrs. 
Black? 

0 cards and telephone calls 
0 cards and flovers 
0 flowers and clothes 
0 food and clothes 
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ERIC 



skill arua 



6. Interpretive 



IV. STUDY-LOCATIONAL 
SKILLS 

A. Alphabetizing 



^ B. Table of contents 
I 



ERIC 



Description of skills assessed 



Given I piBiigt of printed 
oiterlil, the pupil mtt 
choose the correct retponte to 
I written queitlon thit re- 
quires uilflg Ideii tod infonsa- 
tlon, explicitly itited, to 
p»riphr«e, infer from, relite, 
or generiUie from elegenti In 
the piiniKe. 

(Totil and averages for atudy- 
Incetlonal skill areas) 

Hie pupil must choose which 
letter or word comes first In 
alphabetical order. 



Given a table of contents and 
a page nuid)er, the pupil must 
choose the story that begins 
on the given page, 



Ho. of 
Items 



33 



(20) 



10 



10 



Average percent of questions answered correctly 



Grade two 



1974-5 



58.7 



(75.5) 



73.8 75,5 



1975-6 



59.1 



1976. 



60.0 



(77.2) 



77.3 



(77.9) 



76.3 



79.0 



79,6 



I977-f 



60,4 



Grade three 



l97i-5 



74.9 



(79.4) 



78.3 



(88,0) 



87, 



1975-6 



74.9 



1976-7 



75.0 



(88.0) 



87.3 



1977- 



75.5 



(88.8) 



87.9 



(89.6) 



90.4 



Illustrative test question' 



.2 



Where has Hra. Black been: 
0 on a trip 

0 teaching In aaotbtr cUii 
0 lick 

0 visiting out of town 



Teacher sayi: "Hark the word that 
cooes first in alphabetical (ASC) 
order." 

0 dent 
0 drive 
0 dart 
0 dog 



Teacher laya; "A page nuiber la 
underlined. Look at the table 
of coBtentg and then nark the 
title of the story that begins 
on the page that ii underllntd." 



TABIZ OF CONTENTS 




The Happy Puppy 


6 


JobnVi Pet Frog 


12 


The Little Horse 


19 


Holes 


28 


The Lost IVirtle 


32 



Fige I£ 0 The Hippy Puppy 
0 John' I fet Frog 
0 The Uttle Horse 
0 Holes 
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APPENDIX B 



Reading Perfomance, by Skill Arc*, of CiUfornla Sixth-Grade hipUj 
for 1973-76, 1976-77 ind 197:-78 



^tc|ll arna 



Description of skills aflccsscd 



TOIAL READING TEST 



m IDENTIFICATION 



c. m&mi 



III. COHPREHENSION 



A, Literal 



The pupil oust identify correct 
pronunclaticn of words used in 
context, root words, the nieanlng 
of affixes, and contractions. 



The pupil uBt Identify the 
of a specific word in context 



The pupil Mist identify or re- 
loeiDber elenients which have been 
explicitly stated, Ihese 
eleneiits include main Ideas, 
details, and cause-and-effect 
relationships. 



No^ of 
iteiQs 



(128) 
IB 



Average perceni: of questions 
answered correctly^ 



1975-76 



(66,1) 
74J 



23 



(69) 



39 



1976-77 



(65.9) 
74.2 



1977-78 



(iU) 
74J 



67.1 



66.3 



(64.9) 



67,4 



ill 



66.9 



(65.2) 



67.3 



Illustrative test question^ 



Ihfl ending of the word tallest loakei the word 
i&ean: 

0 as tall as 
0 less tall 
0 taller than 
0 flust tall 



Ihe boys made a decision to go camping 
over the weekend, 

Ihe word ^liasty'' as used here Deins: 

0 hurried 
0 wrong 
0 thoughtful 
Ohard 



Travelers say our raada would be safer If we 
changed present road signs to picture syniols, 
or glynphs. Wth these picture signs It Is not 
necessary for travelers to leim the lacguige 
of a country to understand the directions. No 
words are used on ti^t signs. Ihose who favor 
using glynphs in the Uhltrd States admit that 
drivers would have to learn the picture syniols 
first. 

A glyoph Is a: 

0 traveler 
0 road 
0 picture 
0 word 



* The values presented In this col« are averages of the percents of questlona answered correctly. Ihe percentages for individual 
average value by 20 or ncre . points ^ '««i«!ieB m mmmi 



2 



Item nay vary froa the 



qualities of good test itens. 



, er|c 



i 



skill srea 



1 Interpretive/Critical 



IV. STUDY'LOCATIONAL 



Description of skills assessed 



Hie pupil must use Ideas and in- 
formatioa explicitly stkted to 
infer from, relate, or generalize 
Item eleDentfl In the materials 
readt These eleoenta Include 
main Ideas, details, cause-and- 
effect, end author's purposet 

The pupil isust identify which 
reference book to consult and be 
able to use parts of a book such 
as an index and table of contents, 



No. of 
Items 



30 



Average percent of questions 
answered correctly^ 



1975-76 



ill 



16 



60,0 



1976-77 



62,0 



1977-78 



62,2 



59, 



60.; 



Illustrative teat queatlon^ 



Glynphs will probably help 

0 prevent accidents 

0 the blind 

0 you learn to read 

0 you learn other laoguiges 



If you wanted to know the taeanlng of the word 
^IB^ the best book to use would be: 

0 a dictionary 

0 an encyclopedia 

0 an atlas 

0 the card catalog 



AfPENDQC 



!ictdlcig Ferfonaaoct, by Skill Aret, of UUfonli Twtlfth-Gride Student! 
for 1975-76, 1976.77, tti 1977-78 



Skill irea 


Description of skills assessed 


Ho, of 


Avenge percent of queitlons 
iniwered correctly^ 




Item 


1975-76 


1976-77 


1977.78 


Illustritlve tett qveitlon^ 


TOTAL READING TE 


ST 




(64.1) 


(63.6) 


(63.3) 




I. VOCABUIARY 


Itie fltudent mst Identify the 
toeanlng of a specific vord la 
context; given e definition^ the 
student will select froQ a list 
the vord mi nearly opposite in 
laeanln^, 


31 


61.3 


60.9 


60.5 


0 other congressmen 
0 Che voters 
0 Speakers of Che House 
0 coomlttee chainseu 


11. COMENSION 




(57) 


(64.5) 


(63.9) 


(63.7) 




A. Literal 


ProiQ a paragraph or passage, the 
student must identify or re!rd>er 
elenients which have been explicitly 
stated* These eleoents Include 
main Ideas, details, sequence, and 
cause-and'effect relationships. 


47 


(9.2 


68.9 


68,5 


Ihe current reform described in these para- 
graphs was begun by: 

0 Republican Coagressmen 
0 Denocratlc Congressoen 
0 "Ihcle Joe" Cannon 
0 DeiDOcratlc Senators 


B, Interpretive/Critical 


Fron a paragraph or passage, the 
student must use Ideas and in^ 
fonoatlon explicitly stated to 
paraphrase, infer from, relate, 
or generalize from elements. 
Ihese elesients include in&in ideas, 
details, cause-and-effect, and 
author's purpose. 


50 


60.1 


59.3 


59.2 


Hi int! luiurc, ii/HBULLcB uiiLiiscu Will proDaiiiy 

0 opt for a cleaner system. 

0 have to be mt responsible. 

Obe selected by "Uncle Joe." 

0 examine the effects of the earthquke, 


II. STUDY- LOCATML 


The Btudent,«ldft identify which 
reference 'Dook to consult and be 
able to m \ parts of a book, such 
as an Index and table of contents. 

'-J 


13 


68.4 


67.2 


66.6 


To discover last year's Gross National Product 
for the United States, you should consult: 

0 a dictioniry 
0 a thesavrus 
0 an almanac 
0 an encyclopedia 



Uie values presented In this colunin are averajes of the percents of questions answered correctly. Hie percentages for individual Items may vary from the 
average value by 20 or more points, 

^ Tliese sample test iteins are presented for Illustrative purposes only; tbeieforCj they io not cover all of the skills teated, nor do they necessarily 
possess all the qualities of good test Items. 



APPENDIX D 



Written Expression and Spelling Perfpmiance, by Skill Area^ 
of California Sixth-Grade pupUs for 1975-76, 1976-77 and 1977-78 



Skill area 



Description of skills assessed 



TOTAL WRITTEN EXPRESSION TEST 



I. WORD FO?HS (see Horphology 
Test Content Speclflca- 
tlons) 



II. STANDARD USAGE 



III. UNGUAGE CHOICES 



The pupil tnust select the appro- 
priate suffix (-ed, -Ing, -B, -ly, 
-et, -est, 's) for a word In a 
given sentence. 



Hie pupil must select the verb or 
pronoun in a sentence which 
reflects standard English usage. 



TTie pupil must select the most 
vivid vsrb or specific noun for a 
given sentence. 



No. of 
Items 



(128) 



Average percent of <\mtim 
eisvered correctly^ 



1975-76 



16 



26 



(52.5) 
82.4 



1976-77 



(63.6) 
82.3 



75.3 



54.4 



75.3 



56.5 



1977 78 



(64.1) 
82,9 



Illustrative teat que8tion2 



75.8 



55.2 



rill In the oval next to the word that best fits 
each sentence, 

The children were sSlU In the pool. 

0 play 
0 plays 
0 playing 
0 had played 



Fill in the oval next to the word that best fit3 
each sentence. ) 

Leroy the movie yesterday. 

0 saw 
0 seen 



Pretend that you arri writing a story, Fil?, in 
the oval next to the word that will give your 
reader the best picture of what's happealn£. 

The snake across the grass. 

0 aovcd 
0 slithered 
0 went 



1 ' • 

Ihe values preserteo in this column are averajes of the percents of questions answered correctly. Hie percentages for Individual itenis mav vary from the 
average value by 20 or more points. 

' niese sample test iteins are presented for illustrative purposes only; therefore, they do not cover all of the skills tested, nor do they necessarily ' 
possess all the qualities of good test Itejns. 



Skill tret 



IV. SENIENCE RECOGNITION 



V. SimCl HANIPUUTiON 



PUNCTUATION 



Description of skllU asstsBed 



Ihe pupil nuit recogalte conplete 
8iQt«QC«t, frigninti, nm-ooi, tad 
nomil Eogliih vord order la sen* 
tincei. 



I 



Hit pupil mt select the most 
effective sentence or sentence 



Itie pupil must re:opizr vorde In 
I sentence which ehuuIJ be ce- 
pltiUted, such is the beginning 
word of 8 sentence, nines of 
persons ind pieces, diys of the 
veek, end laoaths of the yeir. 



Ihe pupil must identify errors in 
the use of the period, question 
iurk, exclmitlon point, conai, 
apostrophe, ind quotation mirks. 



No. of 
items 



22 



Avenge percent of queitlons 
insveved correctly^ 



1973-76 



62.3 



61.7 



14 



57.4 



18 52.4 



1976.77 



63.0 



1977-78 



Illnstritive test question^ 



63.7 



62.6 



58.4 



63.1 



59.8 



52.5 



54,4 



Fin in the ovil next to the group of words 
vhlch needs laore to sike it i complete sentence. 

0 Ihey bought i house. 
0 She is hungry. 
0 Pedro Is not there. 
0 In the heat of the day. 



Ihe fol loving sentences 5iy the same thing 
differently. Fill la the oval mt to the beat 
sentence. 

0 H]f brother vent and broke the new clock. 
0 Ihe nev clock vas broke by iny brother. 
0 Ihe nev clock vis broken because of my 
brother, 

0 Hy brother broke the nev clock. 



Fill in the oval next to the line vlth the 
mistake L capitalization. If there is no 
mistake, fill la the fourth oval. 

0 In social studies ve are 
0 leimlng about many countries. 
0 ny favorite Is Israel. 
0 (No mistakes) 



Look at the uderlined portion to see If there Is 
in error. If yoii find an error in punctuation, 
fill In the oval next to the letter of that error. 
If there Is no error, tlie losver Is D. 

"I dont mean to refuie the doctor's advice, but 

A B 
I still believe that sunshine Is the best cure 

for a cold^ said Aunt Olive. No error . 
C D 

OA 
OB 
OC 
OD 
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Skill area 



VIII. SPELLING 

A. Relationships 



B. Word Forming 



Description of skills assessed 



From a list of 3 or 4 words,- the 
pupil riust Identify the incorrect 
spelling relationship for vowel 
and consonant sounds* 



No, of 
Urn 



(64) 
35 



Average percent of questions 
answered correctly^ 



1975-76 



(63,6) 
58.1 



The pupil D»uflt select the correct 
spelling patte-n used in a variety 
of common word fonoations. 



1976-77 



(63,6) 



58.1 



1977-78 



(64.1) 



58.6 



Illustrative teat question^ 



29 



70.2 



70.3 



70.8 



Fill in the oval next to the misapelled word 
in each group. If there is no misspelled vjord, 
the answer Is "all correct." 

C steam 
0 scteen 
0 sl^€^:t 
0 All correct 



Pairs of words are given below. In each pair, 
one word is apelled Incorrectly. Fill In the oval 
next to thft correct sptlling. 

0 steped 
0 stepped 



I 



16o 
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APPENDIX E 



Written Expression and Spelling Performance, by Skill Area, of California Twelfth-Grade Students 
for 1975-76, 1976W7, and 1977-78 



Skill area 



Description of; skills assessed' 



No. of 
Items 



Average percent of questions 
answered correctly' 


Illustrative test question^ 


1975W6 


1976-77 


1977-78 


(62.3) 


(61.9) 


(62.1) 




72.6 


72.1 


72.1 


'Sit dogs had the long trek. 








0 survival 








0 survivors , 








0 surviving 








0 survived 


66.9 


66.7 


66.6 


Which of the following is most specific? 








0 plant 








0 redwojd 








0 tree 








0 living thlnX 


67.3 


67.7 


68.4 


Identify the group of words which Is Incooiplate 








or needs additional words co coniplete the meaning 








0 Mack aad Sonny skipped school, 








0 The rising clouds of dust. 








0 The day vaj hot and clear. 








0 Twelve o'clock Is lunchtltae. 











TOTAL WRITTEN EXPRESS ION TEST 



I. WORD FORKS (see Horpholog}^ 
Test Content Specifics - 
tlons) 



II. LANGUAGE CHOICES 



III. SENTENCE RECOGNITION 



The student must select tht np- 
proprlate Inflectional suffix (*ed, 
-Ing, -8, -ly, -er, -est) for a 
given sentence, Eist discriminate 
between fona class words (such as 
noun*' and verbs) and structure 
word:i (such as prepositions), and 
mist demonstrate dictionary skills 
for a variety of purposes. 

The student must Identify attitude- 
conveying words and phrases, inust 
differentiate between specific 
and general sets of words, and 
must Identify the audience of a 



Ihe student must recognize complete 
sentences, sentence parts, sentence 
patterns, and appropriate subject- 
verb relationships. 



(142) 



24 



32 



20 



The values presented in this column are averaRes of the percents of questions answered correctly. Ihe percentages for individual items may vary 
2 from the average value by 20 or more points. 

These sample test items are presented for illustrative purposes only; therefore, they do not cover all of the skills tested, nor do they necessarily 
possess all the qualities of good test items. 



1'- » 

ERIC 



4 



Skill arra 



IV, SENTENCE MANIPUUTION 



V. PAR/\CR.'\i^llS 



7 VI. CAPITALIZATION AND 
PINCTUATION 



VII. SPELLING 



ERIC 



Description of skills assessftd 



The student must select the most 
economical, effective bentence and 
must be able to recognize effective 
coordination and subordination 
within sentences. 



"n^e student must identify irrele 
vant material in a paragraph, 
recognize inconsistent time develop 
raent, select the logical sequence 
of a group of sentences, select 
the sentence which best suiiiniarizes 
the Ideas presented in one or more 
related paragraphs, md identify 
transitional elements within a , 



The student must recognize capi- 
talization and/or punctuation 
errors in sentences, 



The student must decide if an 
underlined word in a given sentence 
Is spelled correctly, 



No. of 
items 



12 



Average percent of questions 
_ answered correctly^ 



1975-76 



42,9 



26 



59.9 



28 



72 



54.6 



1976-77 



^2.9 



1977-78 



43.4 



59.1 



54.3 



59.3 



54.7 



68.0 



67.9 



68.4 



Illustrative test question^ 



Mark the sentence below which expresses the 
thought most EFFECTIVELY and ECONOMICALLY. 

0 He spoke to me In a very warn manner when 

we met each other Ttiesday. 
0 When we met l\iC8day, I was spoken to in a 

very warm manner by hlin. 
0 His manner was very warm when meeting and 

speaking to me I^iesday. 
0 Tuesday he greeted me warmly. 

Vhich of the following phrases is used to Inllcate 
a connection between the two (given) paragraphs? 

0 Could not know 
0 Even so 
0 They lead 
0 Ihey shape 



Identifj' any capitalization or punctuation errors 
In the underlined parts of the following sentence. 

The Hillsj, who have just returned from lake Tahoe, 

are already planning next ^Inter^ji trip. No error . 

C D 



OA 



OB 



CC 



OD 



Fill In the oval next to 'right" if the word is 
spelled correctly or next to "wrong" if the word 
is spelled Incorrectly. 



Carmen steped on my toes. 



0 right 
0 wrong 



-I 



APPENDIX F 



Hsthenatlcs Perfoniance, by Skill Area, of CiUfornli Sixth-Gride Pupils 
for 1975.76, 1976-77 and 1977-78 



Skill area 



Description of skills a',scsjied 



TOTAL HATHEHATICS TEST 



I. ARIIUHEIIC 



A. Wer concepts 

1. Ninber and 
nmieration 



2. Mer theory 



], Ndier properties 



nie pupil irjst identify whole 
numbers, fractions, and decinals; 
identify place value; and recognize 
points on a nuiaber line, 



No, of 
iteas 



The pupil must recognize odd, even, 
prime, and coaposlte nuiibers and 
choose the lowest cooinon multiple 
or greatest comon factor of 
several numbers. 



Ihe pupil must recognize com- 
mutative, associative, and 
distributive properties of 
operations on numbers. 



(160) 
(96) 
(28) 
13 



Average percent of questions 
answered correctly^ 



1975-7I> 



1976-77 



(57,4) 
(61.0) 
(65.4) 
75.0 



56.1 



58.6 



(57.7) 
(61.0) 
(65.5) 
75.6 



56,1 



57.8 



1977-78 



(58,5) 
(61.8) 
(65.6) 
76.3 



56.0 



56.6 



Illustrative teat questien' 



2 



What digit is <n I - tens' place in 4,263? 

0 2 
03 
04 
06 



What is the greatest comin divisor of 8, 12, 
and 16? 

04 
08 
0 12 
0 16 



Name the missing number. 6 x 15 • Q x 6 

09 
0 15 
0 90 

0 None of these 



Ihe valu.is presented in this column are averaijes of t',ie percents of questions answered correctly. The psrcentages for individacl items may vary froin 
the average valve by 20 or more joints. 

These iample test i. s are presented for illustrative purposes only; therefore, they do not cover all of the skills tested, r.t do they Deceeeatlly 
possess all the qual. ies, of good te^t items. 
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Skill area 


,1 

Desoclption of skills assessed 


No, ■o 


Average percent of <piestlons 
aiuwe' ed correctly^ 


1 • 




Itens 


m-if 


1 

1976-77 


1977-78 


Illustrative tett qae8tlor.2 


B. ^ole numbers 




(28) 


(66.9) 


(67.5) 


(6B.0) 




1* Computution 


The pupil wi8t perform addition, 
subtraction, multiplication, and 
u I Vision involving wuolouinbcrs, 


16 


77.4 


77.9 


78.8 


6003 0 6,794 
M ''5|894 
0 5,804 
0 5,794 


2. -ippllcatlon^ 


Hie pupil must apply the four 
arithmetic operations on'whcie 
numbers, solving problems presented 
In a daily life context. 


12 


52.9 


53,6 


53,7 


f 

Joe packs tomatoes 4 to a box. If he hlftj packed 
18 tomatoes, which box Is he now packing? 

j 0 the fourth 
0 the fifth 
0 the sixth 
u Che elgbtoenth 


C. Fractions 




(20) 


(49.6) 


(49.0) 


(50.6) 




1. Computation 


The pupil must perform addition, 
subtraction, multiplication, and . 
aivision involving fractional 
numbers,. 


13 


50.5 


49.8 


52.0 


4x4/7" 0 J 2/7 
0 2 2/7 
0 4 4/7 


2* Application 


The pupil m'jat use the four 
arithmetic operations on fractions 
and mixed numbers to demonstrate 
comprehension or ability to solve 
problems in a daily life context. 


7 


49.0 


47.5 


47.9 


Jack's cpelllng test had 60 words. He spelled 
3/4 of the wrds correctly. How many words did 
Jack disspell? 

0 80 
,0 45, 


D, Decliaals 




'Wi 


(56.3) 


(57.8) 


(59.0) 




1. Coaputation 

* 


The pupil must perform addition, 
subtraction^ ffiuUbMcadonj and 
uivislun involving an\sA\ i jmbirsi 


12 


56.6 


58,9 


o0.6 


62.1 "41.4" 0 10.7 

o:o.7 

.0 21.7 

0 None of these 


2. Application 


The pupil must use the foui 
arithmetic operatlonf on numbers 
In 'leclnal form to demonstrate 
understanding of principles and 
ability to solve probhms In a 
dally life context. 


8 


55,8 

) 
/ 


56.2 


56.7 


Vni Hardi' total expenses during the 8 dayp it 
the i:i:-.ch were $491.60. Uhat m the av^rige 
cost per day? 

0 $61.45 

0 $60.20 

0 Nona of tbste 
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Skill area 



II. GEOMETRY 

A. KnowleJge of facts 



6. Application 



III. MEASUREMEJrr AND GRAPHS 
A. Knowledge of fact? 



Descrii'tton of skills assessed 



The pupil must be able to Identify 
ba^lc geocietrli f'gvrefi. 



No. of 
items 



The pupil must be able to compre- 
hend ana apply basic geometric 
knowledge and concepts, 



The pupil must be able to estimate 
length and volume, convert length, 
mass, volume, and time from one 
unit to another unit; perform 
aritbetlc operations on quantities 
of length, mass, volume, and time, 



(20) 



12 



Average percent of questions 
answered correctly^ 



1975-76 



(58,6) 
68.7 



52.2 



1976-77 



(32) 
14 



(52.1) 
44.8 



(58,5) 



51.9 



(53.5) 
47.2 



1977-78 



(59.3) 
69.7 



32.3 



Illustrative teat question^ 




Tills figure l:.calle(! 
a: 

0 pyramid 
0 prism 
0 cylinder 
0 cone 



Which of the following figures is divided by a 
line of symetry? 



(54.4) 
48.0 



3 yards 1 foot 




0 4 feet 
0 7 feet 
0 ID feet 
0 13 feet 



ir: 
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:'ki]i mi 



B Applicitlon 



ERIC 



Description of ikilU mmti 



Hie pupil oust be ible to lolve 
probleaa related cieiiiureiMnt af 



Till impH rnjst bt able to coiopute 
r^biblL -) of simple events and 
compute tl.t jean, modi; ard median 
of a aet of given niiib^^ 8. 



pupil tDun be able to solve 
problesifl rcUtcd to elenentary 
conccptu :n prohnbiUty and 



No. of 

itfiU 



Avenge percent of quiitlons 
anawered coructlv^ 



1975-76 1976-77 



57.8 



1977-78 



58.4 59.5 



(12) 



(40.4) 



42.4 



(40.9) 



42.3 



38.5 



39.6 



(41.6) 



42.9 



40.2 



IlIuBtntlvt teit queatlon2 




Uae the above graph to find the top safe speed 
for atopplng within i mixlaiiioi distance of 140 
feet. 

0 30 miles per hour 
0 40 miles per hour 
0 50 mllef per hour 
0 120 miles per hour 



If an event is certain to occur, then the 
probability of that event is: 

0 1/2 

0 i 

0 100 

0 zero 



A bowl contains one white marble, two red marbles, 
and three blue mirtles. If you were blindfolded 
snd then reooved one marble from the bowl, what 
Is the probiblUtv that the mirble you renoved 
would be red? 

0 rero 

0 1/3 
0 1/2 
0 2/.^ 

0 Hone of these 
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Hatheoatlcs Perforaance, by Skill Area, o£ CiHfornii 
TtfeUth-Cride Students for 1975-76, 1976-77, and 1977-78 



Skill area 



Description of skills assessed 



TOTAL MATHEMATICS TTST 



ARITHMETIC 



A, Number concepts 

1, Nimber and 
numeration 



2. Nuitber theory 



Hie studMt oust identify whole 
iiuabers, fraclions, m decioala; 
Identify place value; ari recognize 
points on a number line. 



3. Number properties 



Hie student wst recognhe odd, 
even, prline, and composite number'' 
and choose thr lowest connon 
multiple or greatust coimion factor 
of several numbers , 



'he student must recogni coo- 
mutative, associative, and dis- 
tributive properties of operations 
on numbers, 



No, of 
Itrnis 



(138) 
(98) 
('8) 

1', 



Avenge percent of questions 
answered correctlyl 



1975-76 



(67.0) 
(72.9) 
(74.3) 
71.0 



9 ■/6.2 



79,6 



1975-77 



(66.3) 
(72.1) 
(73.5) 
70.1 



■'5.9 



1977-78 



78.5 



(66.3) 
(72.2) 
(73.6) 
69.9 



76.4 



78,6 



Illustrative test question^ 



In which numeral Is the digit 7 In the tens' 
place/ 

0 9 76 .3 
0 97.63 
0 9 . 763 
0 0.9763 



If n Is an 0(id numbor, what can you siy about 
n +"l? 

0 It is always odd. 

0 It la always nven. 

0 It Is even or odd depending upon whit 

n is. 
0 None of these 



Q X 7 ■ (4 X 7) + (5 X 5) 
What mmber goes In the [] above? 



02 
08 
09 
0 20 



The values presented In this column are «vcra^ of the percents of questions answered correctly. The percentages for i!i"7ldual Items van from the 
average value by 20 or more points. 

These sample test items are presented for illustrative purposes only; therefore, they do not cjvcr all of the skills tested, nor do they necessarily 
possess all the qualities of good test items. 
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Skill area 


Description ol skills asbcsicd 


No. of 


Average percent of questloaa 
answered correctly^ 




Items 


1975-76 


1976-77 


1977-78 


Illustrative test question' 


B. Whole nuiobers 




(22) 


(80,1) 


(80.1) 


(80.1) 




1. Cooputatlon 


The student arust pcrforu addition, 
subtraction, multiplication, and 
division involving whole nunibars. 


14 


80,9 


81.0 


81.2 


504 0 405 
- 99 0 415 
0 495 
O505 


2. AppUcatioQ 


The student must appl) the lo^^r 
arlthnetlc operationa on whole 
nunibers in solving problems 
presented in a dally life context. 


8 


78.7 


,'3.j 


78,? 

1 

1 

1 


A ptrHliig lot haa 25 rovs with 18 spaeti for 
cars in each rov. If 3 rows are reooved for a 
drlveviy, what is the greatest nunbei' of cara 
which can be parked on the lot? 

0 375 
0 396 
0 414 
0 447 

0 None of these 


C. Tractlona 




(26) 


(66.0) 


(64.5) 


(64.3^ 




I. Coiputallon 


Ihe BtudeDt must perform addition, 
subcrtction, nultlpllcatlOQ and 
dlvlBlon lnvol':tag frictlousl 
nimbtra. 


14 


70,4 


68.3 


G8.4 


4 X 4/7 - 0 1 2/7 
0 2 2/7 

0 4 1/7 


2. Application 


Tat student oust use the four 
irlthnetlc operations cn frictionn, 
ilxed frictions, or vhole mmbers 
and fractions to deoonitrate 
comprehension or ability to solve 
problem In daily life context. 


12 


60,9 


60.0 


59.5 

1 


Jack's spell'-vg tetc hia 60 words, .^e spelled 
3/4 of the vcrds correctly. How muiy words did 
Jack mstpell? 

080 
0 45 
0 15 
04 


D. Decloals 




(22) 


(71.8) 


(71.2) 


(72.0) 




I. Computation 


The Btuder.1; njst perfn addition, 
subtraction, nuItipUcatlor, Atid 
division Iwolvjng declsil nuaibers. 


14 


74.1 


73.6 


74.8 


786.4 - 34,87 " 0 4.377 
0 43.77 
0 751,53 
0 7,515.3 


I 












m 



Skill area 



2. Application 



II. ALGEBRA 
A, Coinputatlon 



B. Application 



HI. GEOHETRY 

A. Knowledge of facts 



ERIC 



Description of skills asses.ned 



Ihe student nnist use the four 
srith&etic operations on Qunbera in 
decifflil fontt to denonatrite under- 
standing of principles and ability 
to solve problens In daily life 
context. 



Ttie student inust be able to perfom 
addition, subtraction, multiplica- 
tion, and division of algebraic 
variables and Identify a point 
shown on a rectan;,iilar coordinates. 

Hie student must be able to con- 
struct an algebraic equation to 
9oIve a given probles and be able 
to interpret tables, charts, and 



ihe student loust be able to 
identify basic geometric sets and 
figures. 



No. of 
items 



(32) 



Average percent of questions 
aniyei ed .u;^ectly^ 



1973-76 



1976-77 1977-78 



(62.9) 
66.4 



66,6 



(62.1) 
65,9 



(6LB) 
65.5 



iO.l 



(24) 
12 



59,2 



(62J) 
75.2 



(62,1) 
75.5 



58.S 



(61.8) 
75,5 



illustrative test question^ 



If Beth can drive 18.7 loiles on each gallon of 
gas, hov iBlny miles can she drive on 7 gillons? 

0 126.9 
0 130.9 
0 140.9 
0 1309 

0 None of these 



If 7x - 38 ■ 18, then x ^ 



0-8 
0-5 
0 zero 
05 



Ihe folk l;ig forti; \ can often be used to ap- 
proximate the wel : for boys between the ages 
on to 7; 

S- 8 + 2-2 A 

Viitr ^_ is ue weight In kllograoa and A is the 
boy's age in years. Hie foiiula tells that ^or 
each year older that a boy becones, he should 
weigh; 

0 6 kllogra!iis laore 
0 8 kilograms less 
0 2.2 kilograms more 
0 2.2 kilograms less 



Which of the points 
are in the Interior 
of angle RST? 

0 P only 
0 Vonly 
0 V and H 
0 R, S, an: : 




5klll area 



B. Application 



IV. MEASUPfMENT 

A. Knowledge of facts 



Application 



V. PROBABILITY AND STATISTICS 
A. Computitlon 



Ibo 



De.'jLriptlon of skills dsbcssed 



Tlie student Dust be able to 
comprehend and apply basic 
geometric Icnovledge and concepts, 



No. of 
itcnia 



12 



The student oust be able to 
estiaate length and voline; convert 
length, IU86, voluoe, and time fron 
one unit to another unit; and 
perfom arithoetlc operations on 
quantities of length, mass, voluae, 
and tbe. 



(30) 



12 



Average percent of questioiw 
answered correctly^ 



1975-76 



50,1 



1976-;7 



Ihe student oust be able to solve 
problems rulatet^ to nieasureaent of 
length, area, iqass, and volume. 



Ihe student must be able to 
compute the probability of sijuple 
events and coopute the mean, nude, 
and median of a set of given 
numbers, 



(6),5) 
71.6 



1977-78 



(59.5) 
70,5 



18 



(14) 
6 



53.1 



(57.2) 
57.9 



52.2 



(59,4) 



70.1 



Illustrative test question^ 



In the plane of a circle with radius 5,0/' Inches, 
If a point P lies 5.4 inches from the . ^r of 
the circle, then P lies: 

0 on the circle 

0 at the center of the circle 

0 outside the circle 

0 inside the circle but not at the center 



10 decloetues ■ 1 metre | 
1000 alUiaetres ■ 1 metre i 



52.2 



(56.9) 
57.6 



(57.3) 
56.3 



nie length of « piece of chalk la 0.5 decimetre. 
Uhat is Its length in millimetres? 

0 0.05 
05 
0 50 
0 500 



A housewife will pay the lowest price per ounce 
for rice if she buys it at the store which offers: 

0 12 ounces for 40 cents 
0 14 ounces for 45 cents 
0 1 pound, 12 ounces for 85 cents 
0 2 pounds for 99 cents 



Tm, Dick, and Harry lined up to enter their 
clasgrooa. What is the probability that Tom was 
the first one in line? 

0 zero 

0 1/3 
0 2/3 ' 
01 

0 None of these 



Skill area 



Applicicion 



Dt:.crlption of skills assessed 



Hie student must be able to solve 
problems related to elementary 
concepts in probability and 
statistics. 



No. of 
Itenis 



Average percent of questions 
answered correctly^ 



1975-76 



56.6 



1976-?7 



56.3 



1977-78 



56.5 



Illustrative test question' 



f^' It of four boys each* vel^s 60 pounds. Hhat 
if the weight of the fourth boy if the average 
of the weights of all four boys is 70 paondi. 

0 130 pounds 
0 100 pounds 
0 80 pcui'ds 
0 65 pounds 
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APPENDIX E 

A Description of Equating Procedures Used 
in the California Assessment Program 



2rade_Tbree 

School 'level frequency distributions of the total reading score from the Spring, 
1977 administration of the Comprehensive Tests of Ba^ic Skills . Form S, Level 1, 
were obtained from 11 districts: Fountain Valley, Pullerton, Santee, Pctaona,, 
Compton, South San Francisco, Redwood City, Saline City, Ukiah, Berkeley, and 
Ceres. For each school, the number of students tested on the CrB»j and the num" 
ber tested on the Reading Test , Spring, 1977 administration, were <*rttpared* 
When the differ- jnce in the number of pupils te^tM exceeded 10 perceut, the 
school was eli/:d^-ted. Nineteen schools were eliminated for that reason. They 
were replaced oy 19 schools from San Jose Unified, The tc al finao. s -.iA; le included 
138 schools, with 8,699 pupils tested on the CTBS, and 3,b89 tested on the Reading 
T est , after scores of non-English speaking pupils had been eliminated. 

The frequency distribution for the i.^69^ CTES scores was totalled. The scores of 
the 8,589 pupils tested on th^ Reading Tegt were used to estimate what the mea:: 
and variance of total test scores would have been had all students taken th« ful? 
250-item Reading Tes t. The obtained mean and variance were used to nstlmatv. what 
the distribution of scores would have been had all students taken tue total test 
by assumini3 that those tojfcal test scores would have distributed themselves as a 
negative hypergeometric distribution. 

The two frequency distributions — the actual obtained one for the CTBS, and the 
estimated one for the Reading Test — were used to develop an equipercentile equating 
line. This is done by taking any point in one distribution, computing the percent 
or scores lying below that point In the distribution, and thfn tlndlng the point 
in •'he second distribution that has that same percent of scores lying below it. 

Th^2 dlstribt't ' is of scores that would have occurred had all pupils in California 
taken the fu^'. 250 -item Readi ng Test , rather than a 25 item sample were estimated 
for grades two and three. At both grades, this was done by first computing V^he 
estimated total^ttest vari-^^^^ ^rom a 2 percent systematic sample of all pupils^ 
teeted. Again assuming res statewide followed a negatis^e h3rper geometric 

d^ 3tribution, the, sample ance and population mean then were used to estimate 

the statewide distribution of scores. 

From these two distributions, it was estimated that if all pupils in the state 
had taken the full 250~item Read i ng Test in 1977, the median score for grade two 
would have been 182,0, and for grade three, 221,0, From ths equating line, 
these scores equated to CTBS total reading scores of 33 and 53, respectively, 
A total reading score of 33 on L*^e CTBS at the second grade io the 5Sth pe^tentile; 
a score of 53 at the third grade is tuo 56th percentile- 



EKLC 



ISO 



Grade Six 



Equating for grade six was done in a manner very si.ini Lir ic- Ihzii :".;r ..i, 
Di-.Lrict-level ireo-iency distributions for the total reac:nt% tota: langua.;^, 
^md total uathenatlcs scores frotri che Spring, 1977 ad.-!]!;' i stratton r r:e Co:-- 
pr^ehc^nsiv^e Te sts of Ba sic Skills , F-rra S, Level 2, were obtained t'rcn; s..ven 
distrj^ ts: South San Francisco, 'i\.y-^rk, Santee, San Jose, Ukiar\, Cerr-.s, and 
Fountain Vallc^'. These seven districL::^ vere cho-en because thev had adrr- -.. is r or t-. 
^^^e 91^A to th^dT- entire sixtii grade peculation. This was -erlfi<>d against ih^- 
-'^y- tfs^v-.! on tl}±[.y_}^^S^^^.:r^ The tot.:i sa-rlc 

^,"^30, ano 6,8-^3 students t..-sted on t h^-" 3tBS : r't^, .r. 
niath, respect! vt. ] ^- , and 6,7*33 students tested en ^ >ie S?j<. 

Fqulper. L-n: Li..: e- uatlns: M nes were devL-* ..ped for all :.hree areas usiru* 'ht- 
procedures develo;-ed f-: ^^raae hre.- . He statewide variance va'. taU. i-.. r :; 
a one-rhlrt ietS -vsteniati" sample ci the state. Thea, :he siarcvicie -^t:-M a:- v..- 
estimated, bv .nteat c.rea, fo the tptal SHS bv assun^iri;- scores follow.- ^ 
ne^.ativo hvpe r .;.-orH' t r i c distributlcn with '^he po,Milar:on :nean aad vstl-.; 
L:opulation var/ance. The t^uin^atca xedian scores on the w.-r.- . ^ ^ r 

17- items) r.-.iain,;, y:. , I i^,,, c! 17^ l^..^^,s■^ :or vrlttea ex p r es s i ■ >n , ;:J>: ^ . 

■^it^oi 160 for rna^iienuL , Tio.-se oqaat ea u- (THS rac -...ores 01 "^^^ 

•' ^^^-^^ r--ad3ai;, total .an>;-aaiU-, ana to r " t hv^n^a ' . s . r es t i ve 1 v . 
I he cor Tl spend i ••.0 ^^a^ ' -she"^ -^.m- • » j > r .-v.- •■ . ...... r - 



i_-^rad[e_ [ye 1 vr* 

C.il i!or-;u,i tVo:.l;;;-,:rad,- t: M . h. J bee:; t.-..tv.i i : . 

Xo}!!JL.Ai':Li.SLj'-^hiSl^±J. ^ 1> c V t u . n_t . ^: -'..jir,- p;' 1 - ■' O ' ^-rv st -.-- 
•^..'v., !,■;., -J r.-sr, Surv..::.- of Bast.- "Skills: _ _ide_J_ji^ ' v.-i.s intr.'dwi'f-d".' ' Ir "7',^ir„. 

sp,.,-lai ?tudy was co:vi..:,, t ed l.^rMT^n c a^,. - r h,,: sia'ewide -.cr ;7r-.^r7 . 
lorr-.ia t we 1 i c t;-grad.> ;tadents wer: ; b,- ii ;:.,,.v had taken or,/o! thr-.- 
stand.uJLr.d tesrs in January. 1975: lo^>a To.;ts i-d.ir. t iona I Dc-vol 0D!..-nt iiTKlO 

Profiress (TAP> . .sing the- ..timate.^ performance on rhe pn;b ' ! Hh.r s ' Ov OT:: 

aa,.a ;^om ^he aacinist rat : th.- new Mar e-do.e:up..:d te^ts , estin:.uos 

'..iiltornl. .rudent Pf rf orrnaocc-^ in cotr.r.r csor. ro nati-n.l nornis vrre a : 
t •■ 1 n<id tor 197S-76 ar.d 19~A>-7". 

•^amati on of Natlor^ . .n^na Coa^.-. ripens i.ir_K_?.'. - '^S. ;)«{.. r>,.^ ; ■„• ■ • ^„ i 
-.amples cf <,r.:.>-nts were uB'fd f or 0,, tY^a i i nC : V- pc-r f : ::...n. e .>f ■ '..p 7. a t 
sr!:,.cnv so!i;..t.:d J t o :id r i i ■ ; [ > . , - '..r..-r ,,. - ■,;„'" 

sfadet.f drawr. f 

rhe S.;- v,;v^j_ f;ao(_ SJ^j_^- ,,, , , , _ , 

105 sr'.,,.o: . wlrh ahoal "in, -jnrri.rnd.-.-TwJ;-. e st,:.., ,;s ' .\ 

"^^"^ ^^-^--'^ in rh.:. t . ; i ; ! .-d sar.r'.- v.r.; adr:1 7; .:^7r7rt .P-t, 

.ir:a) ot trie foUovini; sra-.d. .li.'cd n-s::: in uhc sprin;- .d l-'- ' ' ^ w.>.-.,- ... 
Linr.uar.o. or MatJun.al i ■ s ; fH StvL- !! Road In,:, ^ni- 1 ! Fx-r.-.;s :.- -r u'm,' 
.-arls; lAf- R.adi.,-, ^ :c .^os u ,i e. , .r ^lath.v.a:. s. Id. ,iata 7, st:ud7^;s v.r 
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rhe procedure for estimating the performance of the median California student 
as compared to publishers* norms Included the following steps. 

1. Linear Equating of the Survey Forms , llie total number of Items In the 
Survey were spread over 18 forms In a stratified random sampling fashion. 
Each form had an approximately equal number of Ite'cs In the three content 
areas; reading, written expression, and mathematlct*. Since Items were 
not exactly equal In each form and since the difficulty value of the Item 
cluster within each content area varied from form to form a linear equating 
procedure was used to convert the raw scores to a common scale scores. For 
each content area the raw scores on 17 forms vere equated to the scale 
score of the chosen form. The transformation equation took the following 
form. 

Y « aX -f b 

where, a =» --r— and b = Y - aX. 

^\ 

2- Estimation of Median Student Perfoimance . The performance of the state's 
twelfth-grade median student on each of the nine standardized tests (three 
tests by three content areas) was estimated by means of a frequency estimation 
procedure-"-. The purpose of the frequency estimation procedure was to estimate 
a marginal frequency distribution for each standardized test, given otay to a 
•mailer group, using the bivarlate distribution of the standardized test with 
the Survey given to the same amall group, and the univariate distribution of 
the Survey given to a larger group. The marginal frequency distribution of 
the standardized test gave the estimated distribution that would have resulted 
if all California twelfth-graders had taken the standardized test The raw 
score corresponding to the median of the estimated distribution represented 
the performance of the median student on the standardized test. The estimated 
raw score^was then converted to the percentile ranking corresponding to the 
publisher's norm sample. The statewide performance on the three standardized 
tests in the three content areas— reading, written expression, and mathematics- 
are given in Table 21. 

Estimation of Nation al Norm Comparisons for 1975-76 . Thp student performance in 
1975-76 on publisher's test was estimated by assuming that the z-score change from 
1974-75 to 1975-76 on the standardized test would be equal to the observed z-score 
change during the same two years on the Survey . Furthermore, it was assumed that 
the performance on the typical California twelfth-grade student was represented 
by the mean statistic both on the standardized tost and on the Survey . In 
particular, the following equatloTi was used to calculate the performance of the 
twelfth-grade students in 1975-76 on the standardized test in raw score unit: 



1 



For details of frequency estimation procedure, see Blanchlni, J.C., "Estimation 
of California Statewide Performance on Selected Standardized Tests at Grades 
6 and 12," ETS, Berkeley, California, 1975, 
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wliere. 



Y' 


a: 


Estimated raw score on the standardized test in 1975-76 


Y 


sr 


Mean raw score on the standardized test in the year 1974-75 


X' 




Mean Survey score on common items in 1975-76 


X 




Mean Survey score on cooomon items in 1974-75 






Standard deviation of the student scores reported by &e 






publisher ^ 
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Estimated standard deviation of the student scores on 






the Survey 



The standard deviation of the student scores on the Survey was estimated using 
the following relationship. 

Standard deviation of the district Standard deviation of the district 

scores on the Survey ^ scores on the ITED 

Standard deviation of the student Standard deviation of the student 

scores on the Survey scores on the ITED 

The standard devit .ions of the student and district scores on ITED were available 
from the statewide testing program data for 1973-74. The standard deviation of, 
the district scores on the Survey was calculated from the data available from the 
1975-76 administration of the Survey > 

The percentile rank corresponding to the estimated mean on the standardized test, 
Y', was obtained using the test publisher's norm table. The percentile ranks were 
linearly Interpolated from the norm table, if necessary, to find the percentile 
ranking corresponding to a fractional raw score. Table 24 provides the estimated 
performance of California twelfth-grade students for 1975-76. 

Estimation of National Norm Comparison for 1976-77 and 1977-78 . The estimation 
procedures for 1976-77 and 1977-78 were the same as the procedures used in 1975-76 
exu-ept that in the later years' estimations, the values of X and X* were based 
upon all item data becausevthe tests for the three years were exactly the same. 
Table 24 provides the estimated performance of California twelfth grade students 
for 1976-77 and 1977-78. 
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